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© This invention is intended to enable accurate 
and high-speed pattern recognition even when an 
object to be identified changes its size, rotating 
angle or position. 

The invention comprises: 

an optical coordinate converter for displaying at 
least one reference image including specified marks 
and at least one input image to be entered on an 
electrically addressed spatial light modulator 3 for 
object image and then converting the displayed im- 
ages from one coordinate system to a desired co- 
ordinate system to produce coordinate-converted im- 
ages by using the coordinate conversion optical filter 
array 44 and the coordinate conversion lens array 
47; and 

a joint transform correlator for displaying the 



coordinate-converted intensity distribution images, 
produced by the optical coordinate converter, on the 
coordinate conversion light-addressed spatial light 
modulator 13, Fourier-transforming the coordinate- 
converted intensity distribution images into Fourier- 
transformed intensity distribution images, displaying 
the Fourier-transformed intensity distribution images 
on the Fourier transform light-addressed spatial light 
modulator 105, and Fourier-transforming again the 
Fourier-transformed intensity distribution image to 
determine the correlation coefficients of the 
coordinate-converted reference image and the 
coordinate-converted input image. 

With this construction, it is possible to change 
the reference image and the kind of coordinate con- 
version easily and quickly. 
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BACKGROUND OF THE INVENTION 

In a field of optical information processing and 
optical measurement, the present invention relates 
to an apparatus which uses coherent light beams to 
perform optical coordinate conversion and optical 
correlation processing on two-dimensional images 
obtained from photographing devices such as CCD 
cameras. 

Among conventional correlators that perform 
optical pattern recognition, VanderLugt type and 
Joint Transform type correlators are well known. 
Either method is based on an optical Fourier trans- 
form using lens, so that an input image to be 
identified, when parallelly moved, can be recog- 
nized without a problem (shift invariability). When 
the input image is rotated or its size changed, the 
correlation peak intensity described later is not 
invariable and the recognition capability is found to 
degrade according to the extent of the rotation and 
size change. 

In conventional apparatuses, when 
objects—such as characters or device parts whose 
shapes, sizes, directions and positions differ from 
one object to another— are to be optically mea- 
sured and identified, the following steps are gen- 
erally followed. The input object is first converted 
into a two-dimensional image (input image); sec- 
ond, when there is any rotation or size change 
found with the input image, the input image is 
converted into a desired coordinate system where 
the correlation peak intensity becomes invariable 
for such changes as rotation or size changes re- 
quired for the recognition of the input image; and 
third, the coordinate-converted image is then mea- 
sured or identified. 

Various coordinate conversions may be used 
according to purposes. For the recognition pro- 
cessing and the rotating angle measurement of 
objects with differing directions, a polar coordinate 
conversion is employed. For objects both with dif- 
fering directions and sizes, the recognition process- 
ing and the rotating angle and magnification mea- 
surement are performed by means of coordinate 
conversion from (x, y) coordinates to (Inr, o) coordi- 
nates, r and $ represent a radius vector and a 
declination in the polar coordinates. 

First, the outline of the optical coordinate con- 
version method is shown in Figure 2. With this 
method, a liquid crystal television 303 displaying 
an image to be converted and a coordinate conver- 
sion optical filter 304 are put close together at the 
front focal plane of a coordinate conversion lens 
307. A parallel-ray coherent beam is radiated from 
behind the liquid crystal television 303 to form a 
desired coordinate-converted image on a liquid 
crystal light valve 308 placed on the rear focal 
plane of the coordinate conversion lens 307. The 



coordinate conversion optical filter 304 is made by 
using a computer generated hologram (CGH). Ei- 
ther of the liquid crystal television 303 and the 
coordinate conversion optical filter 304 may be 
5 placed in front of the other as long as they are put 
close together. 

The liquid crystal light valve 308 commonly 
uses an TN liquid crystal as the light modulating 
material. Instead of the liquid crystal light valve 
io 308, a light-addressed spatial light modulator may 
be used which employs a BSO crystal (Bii 2 Si02o) 
as the light modulating material. The coordinate- 
converted image is thrown onto the spatial light 
modulator to display and store the coordinate-con- 
75 verted image, and then the coherent light is irradi- 
ated onto the spatial light modulator to read out the 
coordinate-converted image for such processing as 
the pattern recognition. Other method is also avail- 
able, which involves using a photographing device 
20 such as CCD camera instead of the light-addressed 
spatial light modulator to receive the coordinate- 
converted image and then entering the image sig- 
nal into an electrically addressed spatial light 
modulator such as liquid crystal television. 
25 Among the known pattern recognition methods 
using the coordinate conversion is one which uses 
an ordinary VanderLugt type correlator to perform 
a preprocessing on the coordinate-converted im- 
age. Figure 3 shows the configuration of the Ven- 
30 derLugt type correlator having the conventional co- 
ordinate conversion function. This method is de- 
scribed by referring to the drawing. 

As the first step, a matched filter for the refer- 
ence image is made. At this step, the reference 
35 image is displayed on the liquid crystal television 
303. The coherent light emitted from the laser 307 
is expanded by a beam expander 302 and then 
split into two beams by a beam splitter 305. One of 
the split beams passes through the liquid crystal 
40 television 303, which is showing the reference im- 
age, and the coordinate conversion optical filter 
304 and is Fourier-transformed by the coordinate 
conversion lens 307 before striking the write plane 
of the liquid crystal light valve 308. In this way, the 
45 coordinate-converted intensity distribution image of 
the reference image is displayed on the liquid 
crystal light valve 308. The other of the beams split 
by the beam splitter 305 is reflected by a mirror 
306, a beam splitter 309 and a polarizing beam 
so splitter 310 and irradiates the read plane of the 
liquid crystal light valve 308 to transform the 
coordinate-converted intensity distribution image 
into a coherent image. The coherent image passes 
through the polarizing beam splitter 310 and is 
55 Fourier-transformed by a Fourier transform lens 
311 before striking a photographic plate 312 as 
signal light during the hologram making. At the 
same time, a light beam that has passed through 
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the beam splitter 309 travels through a shutter 373, 
which is open, and is reflected by a mirror 374 to 
radiate onto the photographic plate 372 as refer- 
ence light during the hologram making. At this 
time, the signal light and the reference light strike 
the photographic plate 372 at specified angles to 
form a hologram on the photographic plate 372. 
The liquid crystal light valve 308 is located at the 
front focal plane of the Fourier transform lens 377 
and the photographic plate 372 at the rear focal 
plane of the lens. The photographic plate 372 
formed with the hologram is taken out and devel- 
oped and then returned to the original position. The 
photographic plate 372 recorded and developed 
with the hologram is called a matched filter. 

Next in the second step, the correlation pro- 
cessing is performed. Processing similar to the first 
step is omitted in the following description or only 
briefly explained. The second step displays the 
input image on the liquid crystal television 303. As 
in the first step, the coordinate-converted intensity 
distribution image is displayed on the liquid crystal 
light valve 308, is read out and Fourier-transformed 
by the Fourier transform lens 377 and then is 
radiated onto the photographic plate 372, a 
matched filter. Unlike the first step, the shutter 373 
is closed so that the reference light does not strike 
the photographic plate 372. The light that has 
passed through the photographic plate 372 or the 
matched filter is Fourier-transformed again by the 
Fourier transform lens 375 so that a correlation 
peak representing the correlation coefficient of the 
reference image and the input image is produced 
on a light receiving element 376 located on the 
conversion plane of the lens. The photographic 
plate 372 is located on the front focal plane of the 
Fourier transform lens 375 and the light receiving 
element 376 on the rear focal plane of the lens. 

With the above method, however, there are 
three problems that arise from the use of the 
photographic plate as a medium or a matched filter 
on which the hologram is recorded. 

First, it is necessary to form a hologram on the 
photographic plate and then take the photographic 
plate out to develop it, requiring time and labor. 
Second, when the photographic plate, after being 
developed, is returned to the original position, it is 
very difficult and troublesome to adjust it exactly to 
the original position. In particular, the photographic 
plate must be so set that its light axis is aligned 
with the center of the hologram and that the plate 
is not rotated or warped. Third, when the reference 
image is to be changed, either a new matched filter 
must be made or the old filter be replaced with a 
prefabricated matched filter, making it impossible 
to change the reference image in real time or at 
high speed. For the reasons mentioned above, it 
has been impossible to form a pattern recognition 



apparatus which has a coordinate conversion func- 
tion capable of a real-time operation in a useful 
level. 

The use of the VanderLugt type correlator 
5 poses the following problem. The hologram formed 
on the photographic plate usually has a large angle 
of about several tens of degrees between the sig- 
nal light and the reference light, so that the inter- 
vals between interference fringes are very narrow 
w at about several hundred Ip/mm. Therefore, the 
process of making the matched filter is easily af- 
fected by vibrations and wind. If the interference 
fringes should oscillate due to such influences, a 
precise hologram cannot be recorded, deteriorating 
75 the pattern recognition capability. 

SUMMARY OF THE INVENTION 

An object of this invention is to provide an 
20 optical pattern recognition apparatus which can 
perform an accurate pattern recognition operation 
even when the size and direction of an input object 
are changing. 

Another object of the invention is to provide an 
25 optical pattern recognition apparatus which can 
easily change the kind of coordinate conversion 
and the reference image at high speed. 

The optical pattern recognition apparatus ac- 
cording to this invention comprises: 
30 an optical coordinate converter unit for convert- 

ing at least one reference image and at least one 
input image to be entered, from one coordinate 
system to a desired coordinate system to produce 
coordinate-converted image; and 
35 a joint transform correlator for generating cor- 

relation coefficients between the coordinate-con- 
verted reference image and the coordinate-con- 
verted input image, both produced by the optical 
coordinate converter; 
40 the optical coordinate converter comprising: 

a means for producing two-dimensional refer- 
ence image and input image; 

at least one coherent light source; 
at least one object image spatial light modula- 
45 tor which holds the reference image and the input 
image; 

at least one coordinate conversion optical filter 
placed closer to the object image spatial light 
modulator; and 
50 at least one lens; 

the joint transform correlator comprising: 
a means for converting the coordinate-convert- 
ed reference image and the coordinate-converted 
input image produced by the optical coordinate 
55 converter into coordinate-converted intensity dis- 
tribution images and then displaying the 
coordinate-converted intensity distribution images 
on a spatial light modulator for the coordinate- 
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converted images; 

a means for converting the coordinate-convert- 
ed intensity distribution images displayed on the 
coordinate-converted image spatial light modulator 
into coherent images; f 5 

a means for converting the coherent image by 
using a lens for Fourier-transforming into a joint 
Fourier-transformed image of the coordinate-con- 
verted intensity distribution image; 

a means for converting the joint Fourier-trans- 10 
formed image into a Fourier-transformed intensity 
distribution image and displaying the Fourier-trans- 
formed intensity distribution image on a spatial 
light modulator for the Fourier-transformed image; 

a means for reading the Fourier-transformed 75 
intensity distribution image displayed on the 
Fourier-transformed image spatial light modulator 
by using coherent light; 

a means for converting a correlation output 
image, obtained by Fourier-transforming the 20 
Fourier-transformed intensity distribution image by 
using a lens, into a correlation signal by a photog- 
raphing device or light receiving element; and 

a means for processing the correlation signal 
to determine two-dimensional correlation coeffi- 25 
cients of the reference image and the input image. 

In the optical pattern recognition apparatus 
which has the above configuration and the coordi- 
nate conversion function, the input image and the 
reference image are optically converted by a co- 30 
ordinate conversion optical filter into a coordinate 
system where the correlation peak intensity be- 
comes invariable for rotational and size changes. 
This assures pattern recognition with invariable per- 
formance for the object images that change in size 35 
and direction. 

Since this invention is based on the joint trans- 
form correlator, not the VenderLugt type correlator, 
the change of the coordinate conversion optical 
filter to change the coordinate conversion kind or 40 
the replacement of the reference image can be 
done simply by changing the reference image or 
coordinate conversion optical filter. This eliminates 
the need for a series of steps including re-record- 
ing, developing and replacing the matched filter 45 
and then making the light axis adjustment, there- 
fore ensuring a very easy and quick replacement 
or change of the filter and the reference image. 

The light axis adjustment for the entire optical 
system of the pattern recognition apparatus is very 50 
easy when compared with the VanderLugt type 
correlator. Hence, the optical system is little af- 
fected by vibrations of the apparatus or movement 
of air. 

55 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a schematic diagram showing the 



configuration of the optical pattern recognition 
apparatus, as one embodiment of this invention, 
which has a coordinate conversion function; 
Figure 2 is a schematic diagram showing the 
outline of the optical coordinate conversion 
method; 

Figure 3 is a schematic diagram showing the 
configuration of a conventional VanderLugt type 
correlator which has a coordinate conversion 
function; 

Figure 4 is one example method of displaying a 
reference image and an input image a distance 
L apart on an electrically addressed spatial light 
modulator 3; 

Rgure 5 is a cross section of a liquid crystal 
light valve of the invention using a ferroelectric 
liquid crystal; 

Rgure 6 is an example waveform diagram show- 
ing the relationship between the reading laser 
output and the drive voltage applied to an opti- 
cally addressed ferroelectric liquid crystal light 
valve, with (a) representing the drive voltage for 
an optically addressed spatial light modulator 
703, (b) representing the output of a laser 707, 
(c) representing the drive voltage for an optically 
addressed spatial light modulator 705, and (d) 
representing the output of a laser 201. 
Rgure 7 is a schematic diagram showing the 
configuration of another embodiment of the op- 
tical pattern recognition apparatus which has the 
coordinate conversion function; 
Rgure 8 is an example arrangement of an input 
images and a plurality of reference images; 
Rgure 9 is a schematic diagram showing the 
configuration of one embodiment in which a 
feedback system is added to the optical pattern 
recognition apparatus of the invention having the 
coordinate conversion function; 
Rgure 10 is a schematic diagram showing the 
configuration of a further embodiment of the 
optical pattern recognition apparatus which has 
the coordinate conversion function; 
Figure 11 is a schematic diagram showing the 
configuration of a further embodiment of the 
optical pattern recognition apparatus which has 
the coordinate conversion function; 
Rgure 12 is a schematic diagram showing the 
configuration of a further embodiment of the 
optical pattern recognition apparatus which has 
the coordinate conversion function; 
Rgure 13 is a schematic diagram showing the 
configuration of a further embodiment of the 
optical pattern recognition apparatus which has 
the coordinate conversion function; 
Rgure 14 is a schematic diagram showing the 
configuration of a further embodiment of the 
optical pattern recognition apparatus which has 
the coordinate conversion function; 
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Figure 15 is a schematic diagram showing the 
configuration of one embodiment of an optical 
pattern recognition apparatus having the coordi- 
nate conversion function, in which an automatic 
light adjusting unit for the coordinate-converted 
image is added; 

Figure 16 is a schematic diagram showing the 
configuration of a further embodiment of the 
optical pattern recognition apparatus which has 
the coordinate conversion function; 
Figure 17 is a schematic diagram showing the 
configuration of a further embodiment of the 
optical pattern recognition apparatus which has 
the coordinate conversion function; 
Figure 18 is a schematic diagram showing the 
configuration of a further embodiment of the 
optical pattern recognition apparatus which has 
the coordinate conversion function; 
Figure 19 is an example method of displaying a 
reference image and a shifted input image on an 
electrically addressed spatial light modulator 
403; and 

Figure 20 is an example method of displaying 
shift-invariable intensity distribution images of a 
reference image and an input image, a distance 
L apart, on an electrically addressed spatial light 
modulator 468. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Now, embodiments of the invention will be 
described by referring to the accompanying draw- 
ings. 

Figure 1 shows the configuration of the optical 
pattern recognition apparatus, as one embodiment 
of the invention, which has a coordinate conversion 
function. An optical coordinate converter has the 
following configuration: a means for producing two- 
dimensional reference image and input image con- 
sists of a first input image photographing device 2, 
a first image processing device 42 and an image 
memory device 43; at least one coherent light 
source consists of a first coordinate conversion 
laser 5 and a first coordinate conversion beam 
expander 6; and at least one object image spatial 
light modulator that holds the reference image and 
the input image is a first electrically addressed 
spatial light modulator 3 for input image; at least 
one coordinate conversion optical filter placed 
close to the object image spatial light modulator is 
a coordinate conversion optical filter array 44; and 
at least one lens is a coordinate conversion lens 
array 47. A joint transform correlator has the follow- 
ing configuration: a means for converting into 
coordinate-converted intensity distribution images 
the coordinate-converted images of the reference 
image and the input image obtained in the optical 



coordinate converter, consists of a mask 48 and a 
first electrically addressed spatial light modulator 
for coordinate conversion; a means for converting 
the coordinate-converted intensity distribution im- 
5 ages displayed on the coordinate-converted image 
spatial light modulator into coherent images con- 
sists of a Fourier transform laser 101, a Fourier 
transform beam expander 102, and a first Fourier 
transform polarizing beam splitter 103; a means for 
w Fourier-transforming the coherent images by using 
a lens and producing a joint Fourier-transformed 
image of the coordinate-converted intensity dis- 
tribution images consists of a first Fourier transform 
lens 104; a means for converting the joint Fourier- 

75 transformed image into a Fourier-transformed in- 
tensity distribution image and displaying the 
Fourier-transformed intensity distribution image on 
a Fourier-transformed image spatial fight modulator 
consists of a light-addressed spatial light modulator 

20 105 for Fourier-transformed image; a means for 
reading by the coherent light the Fourier-trans- 
formed intensity distribution image displayed on 
the Fourier-transformed image spatial light modula- 
tor consists of a correlation laser beam 201, a 

25 correlation beam expander 202 and a correlation 
polarizing beam splitter 203; a means for Fourier- 
transforming again the Fourier-transformed inten- 
sity distribution image thus read out by using a 
lens to produce a correlation output image and 

30 then converting the correlation output image into a 
correlation signal by using a photographing device 
or a light receiving element, consists of a second 
Fourier transform lens 204 and a light receiving 
element 205; and a means for processing the cor- 

35 relation signal to determine two-dimensional cor- 
relation coefficients of the reference image and the 
input image consists of an identification circuit 206. 

First, the reference object, database of a refer- 
ence for pattern recognition, is placed at a position 

40 of an input object 1 and photographed by a 
photographing device 2 to produce a two-dimen- 
sional reference image. The two-dimensional refer- 
ence image is then stored via an image processor 
42 into an image memory device 43. Likewise, an 

45 input object T, which is to be identified, is photo- 
graphed by the photographing device 2 to produce 
a two-dimensional input image. The input image 
and the reference image, the latter being stored in 
the image memory device 43, are synthesized by 

so the image processor 42 and displayed on an elec- 
trically addressed spatial light modulator 3. The 
reference image and the input image are displayed 
a certain distance L apart so that they do not 
overlap, as shown in Figure 4. 

55 An optical filter array 44 consists of two coordi- 
nate conversion optical filters, both made by com- 
puter generated hologram, arranged a specified 
distance L apart. In the coordinate conversion pro- 
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cess, if Images to be converted are not in the same 
positional relationship with respect to the coordi- 
nate conversion optical filter, the conversion will 
produce different coordinate-converted images 
even when the same image is coordinate-convert- 
ed. For this reason, the distance between the two 
coordinate conversion optical filters must be equal 
to the distance L between the reference image and 
the input image so that the relative positional rela- 
tion of the reference image with the coordinate 
conversion optical filter will be equal to the relative 
positional relation of the input image with the co- 
ordinate conversion optical filter. 

The coherent light emitted from the laser 5 is 
expanded by a beam expander 6 into a parallel-ray 
beam of a specified diameter and then radiated 
onto the electrically addressed spatial light modula- 
tor 3 on which the input image and the reference 
image are displayed. Then, these images are con- 
verted into coherent images. The coherent images 
pass through optical filters on the optical filter array 
44 put close to the electrically addressed spatial 
light modulator 3 and are then Fourier-transformed 
by respective coordinate conversion lenses on a 
lens array 47. As a result, coordinate-converted 
images that are converted into a desired coordinate 
system are formed on the Fourier transfer plane. A 
mask 48 placed immediately before the light-ad- 
dressed spatial light modulator 73 are formed with 
holes to allow only the + first order coordinate- 
converted images to pass through. This cuts off 
unwanted dc bias components and high-order 
coordinate-converted images and only the neces- 
sary coordinate-converted images of the reference 
and input images pass through the mask to radiate 
onto the write plane of the light-addressed spatial 
light modulator 73. The coordinate-converted input 
and reference images are converted into 
coordinate-converted intensity distribution images, 
which are displayed a distance L apart on the light- 
addressed spatiaJ light modulator 13. There are 
many kinds of light-addressed spatial light modula- 
tor 13. In this embodiment, the light-addressed 
spatial light modulator employs a reflection type 
liquid crystal light valve which uses a ferroelectric 
liquid crystal as the light modulating material. 

On the front focaJ plane of the lens array 47 
are located an electrically addressed spatial light 
modulator 3 and an optical filter array 44, both 
arranged close together. On the rear focal plane is 
positioned an electrically addressed spatial light 
modulator 13. The coordinate conversion lenses, as 
with the coordinate conversion optical filters, are 
arranged a distance L apart at positions that cor- 
respond to the two images being converted. 

The coherent light emitted from the laser 101 
is expanded by a beam expander 102 into a 
parallel-ray beam of a specified diameter and then 



reflected by a polarizing beam splitter 103 to ra- 
diate onto the read plane of the light-addressed 
spatial light modulator 13 as the reading light. The 
light-addressed spatial light modulator 13 and its 
5 operation will be described in detail. The polarizing 
direction of the reading light is aligned beforehand 
with the alignment direction of the liquid crystal 
molecules (or aligned with a direction perpendicular 
to it), in which direction the liquid crystal molecules 

w are aligned by initialization of the spatial light 
modulator. By passing the reading light— which was 
reflected by the light-addressed spatial light 
modulator 13— through a detector whose polarizing 
axis is set perpendicular or parallel to the polariza- 

15 tion direction of the reading light, the image dis- 
played on the light-addressed spatial light modula- 
tor 13 can be read out as a positive image or a 
negative image. In this embodiment, a polarizing 
beam splitter 103 is used as a detector. 

20 In this way, the coordinate-converted intensity 
distribution image is converted into a coherent im- 
age and then Fourier-transformed by the lens 104 
into a joint Fourier-converted image— which repre- 
sents the coordinate-converted intensity distribution 

25 image for the reference image and the input 
image-on the Fourier transfer plane. On the Fourier 
transfer plane is placed the write plane of a light- 
addressed spatial light modulator 705, on which the 
intensity distribution of the joint Fourier-transformed 

30 image consisting of each coordinate-converted in- 
tensity distribution image for the reference and 
input image is displayed as the Fourier-transformed 
intensity distribution image on the light-addressed 
spatial light modulator 105. In this embodiment, 

35 too, a reflection type liquid crystal light valve using 
a ferroelectric liquid crystal is used as the light- 
addressed spatial light modulator 105 as with the 
light-addressed spatial light modulator 73. The 
light-addressed spatial light modulator 73 is located 

40 at the front focal plane of the lens 704 while the 
light-addressed spatial light modulator 705 is posi- 
tioned at the rear focal plane. 

The coherent light emitted from the laser 207 
is expanded by a beam expander 202 into a 

45 parallel-ray beam of a specified diameter and then 
reflected by a polarizing beam splitter 203 to ra- 
diate onto the read plane of the light-addressed 
spatial light modulator 705 as the reading light. In 
this case, too, as with the light-addressed spatial 

so light modulator 73, the Fourier-transformed inten- 
sity distribution image displayed on the light-ad- 
dressed spatial light modulator 705 is converted 
into a coherent image. The detector, however, em- 
ploys a polarizing beam splitter 203. The coherent 

55 image thus read out is Fourier-transformed by the 
lens 204 to form a correlation output image includ- 
ing a correlation peak on a light receiving element 
205 located on the Fourier-transfer plane. The light 
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receiving element 205 picks up only the correlation 
peak in the correlation output image and converts it 
into a correlation signal. The correlation signal is 
entered into an identification circuit 206 which mea- 
sures the correlation peak intensity to produce cor- 
relation coefficients of the input image and the 
reference image. The light-addressed spatial light 
modulator 705 is located at the front focal plane of 
the lens 204 while the light receiving element 205 
is positioned at the rear focal plane. 

For strict Fourier transform, it is preferred that 
the image to be Fourier-transformed be put on the 
front focal plane of each Fourier transform lens or 
between the lens and its rear focal plane. Then the 
Fourier-transformed image is formed on the rear 
focal plane of the lens. In this embodiment, there- 
fore, the image is placed on the front focal plane of 
the lens array 47, lens 704 and lens 204 and the 
Fourier-transformed image is received on the rear 
focal plane. 

In this embodiment, the reflection type liquid 
crystal light valve using the ferroelectric liquid cry- 
stal is used as the light-addressed spatial light 
modulators 73, 105. When the TN liquid crystal, a 
well-known light modulating material, is used, the 
gradation display can be made but there are 
drawbacks such as a low resolution at about 30 
Ip/mm and a slow operation speed at the video rate 
of around 30 Hz. To solve this problem, this em- 
bodiment uses a ferroelectric liquid crystal rather 
than the TN liquid crystal as the light modulating 
material. The liquid crystal light valve using the 
ferroelectric liquid crystal has the resolution of 
about 100 Ip/mm and the operation speed of ar- 
ound several kHz, excellent characteristics. What 
should be noted here, however, is that the liquid 
crystal light valve using the ferroelectric liquid cry- 
stal has a bistability and therefore stores the write 
image in binary state or digitally stores it. Since in 
this embodiment, the coordinate-converted inten- 
sity distribution image and Fourier-transformed in- 
tensity distribution image are binarized and stored, 
they are a binarized coordinate-converted intensity 
distribution image and a binarized Fourier-trans- 
formed intensity distribution image. Possible light 
modulating materials other than the liquid crystal 
may include electro-optical crystals such as BSO 
crystals. It is also noted that a transmission type 
light-addressed spatial light modulator works in the 
same principle as the reflection type. Rather than 
using the light-addressed spatial light modulator, it 
is also possible to use a combination of a photog- 
raphing device and a light-addressed spatial light 
modulator. This method will be described later in 
detail. 

Next, we will explain about the construction 
and operation of the reflection type liquid crystal 
light valve, used as the light-addressed spatial light 



modulator in this embodiment, which employs a 
ferroelectric liquid crystal as the light modulating 
material. What differs from the conventional liquid 
crystal light valve is the use as the liquid crystal 
5 layer of the ferroelectric liquid crystal that has a 
definite bistability between the light transmission 
factor or light reflection factor and the applied 
voltage. Figure 5 shows the cross section of the 
liquid crystal light valve using the ferroelectric liq- 

ro uid crystal. Transparent substrates 737a, 131b 
such as glass and plastics that sandwich crystal 
molecules are provided at the surfaces with trans- 
parent electrodes 732a f 7326 and alignment layers 
733a, 7336, the alignment layers being oblique- 

75 evaporated with silicon monoxide in the range of 75 
to 85 degrees from the direction normal to the 
transparent substrate. The transparent substrates 
737a, 7376 clamp a ferroelectric liquid crystal layer 
734, with their alignment layer 733a, 133b sides 

20 facing each other to control a gap located there- 
between in which spacers 139 are installed. Be- 
tween the transparent electrode 732a and the align- 
ment layer 733a on the optical writing side is 
formed a photoconductive layer 735, a light shield- 

25 ing layer 736 and a dielectric mirror 737 put close 
together. The cell outer surfaces of the writing side 
transparent substrate 737a and the reading side 
transparent substrate 131b are formed with anti- 
reflection coatings 738a, 7336. 

30 In the above structure, when the visible light 
reflection factor of the dielectric mirror 737 is suffi- 
ciently large and there is very little effect of the 
reading light on the photoconductive layer 735, the 
light shielding layer 136 may be omitted. Further, 

35 when the reflection factor of the photoconductive 
layer 735 for the reading light is sufficiently large 
and the reading light has a sufficiently small inten- 
sity and has very little effect on the photoconduc- 
tive layer 735, the dielectric mirror 737 can also be 

40 eliminated. In this embodiment, however, since the 
normal coordinate-converted intensity distribution 
image has a small area and the utilization of the 
reading light is low, the reading light should prefer- 
ably be strong. For this reason, the light-addressed 

45 spatial light modulator 73 that displays the 
coordinate-converted intensity distribution image 
should preferably have the light shielding layer 736 
and the dielectric mirror 737. Conversely, since the 
Fourier-transformed intensity distribution image has 

so a not-so-small area, the reading light may be weak. 
Thus, the light-addressed spatial light modulator 
705 that displays the Fourier-transformed intensity 
distribution image may not necessarily incorporate 
the light shielding layer 736 and the dielectric 

55 mirror 737. 

Next, the method of initializing the liquid crystal 
light valve with the above construction. The first 
method involves irradiating with light the entire 
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write plane of the liquid crystal light valve, applying 
between the transparent electrodes 132a and 132b 
a pulse voltage or dc bias voltage sufficiently high- 
er than a lighted-state threshold voltage or a dc 
bias voltage superimposed with 100Hz-50kHz ac 
voltage to align the ferroelectric crystal molecules 
in one stable direction, and then storing this con- 
dition in memory. The second method consists of 
applying between the transparent electrodes 732a 
and 132b a pulse voltage or dc bias voltage suffi- 
ciently higher than a dark-state threshold voltage or 
a dc bias voltage superimposed with 100Hz-50kHz 
ac voltage to align the ferroelectric liquid crystal in 
one stable direction, and then storing that condition 
in memory. Normally, the dark-state threshold volt- 
age is higher than the lighted-state threshold volt- 
age. 

Now, the operation after the liquid crystal light 
valve is initialized as mentioned above will be ex- 
plained. A picture is written with a laser beam while 
the transparent electrodes 132a and 7326 are im- 
pressed with a pulse voltage or dc bias voltage, or 
a dc bias voltage superimposed with 100Hz-50kHz 
ac voltage, whose polarity is reverse to that when 
the initialization was performed and whose mag- 
nitude is lower than the dark-state threshold voltage 
and higher than the lighted-state threshold voltage. 
The area of the photoconductive layer 735 struck 
by the laser beam produces carriers, which are 
drifted in the direction of electric field by the ap- 
plied voltage, causing a drop in the threshold volt- 
age. This in turn applies to the laser-irradiated area 
a voltage whose polarity is reverse to that of the 
voltage when the initialization was performed and 
whose magnitude is higher than the threshold volt- 
age. The applied voltage causes the ferroelectric 
liquid crystal to reverse its molecules into another 
stable state as a result of spontaneous polarizing, 
binarizing and storing the image in memory. 

The binarized and stored image can be read 
out in positive or negative state by radiating a 
linearly polarized reading light whose polarizing 
axis is arranged in the direction of alignment of the 
initialized crystal molecules (or in a direction per- 
pendicular to it) and by passing the reflected light 
from the dielectric mirror 737 through a light detec- 
tor, whose polarizing axis is perpendicular (or par- 
allel) to the polarizing direction of the reflected 
light. In the embodiment of Figure 1, a polarizing 
beam splitter is used instead of the detector. 

The threshold value for binarizing the image 
can be changed by adjusting the magnitude and 
width of the pulse voltage or the frequency of ac 
voltage, or the magnitude of dc bias voltage, all 
applied between the transparent electrodes 732a, 
132b. Also by adjusting the power of the laser to 
change the intensity of light irradiated against the 
write plane, it is possible to produce virtually the 



same effect as when the threshold value is 
changed. 

Next, the method of driving at high speed the 
liquid crystal light valve that uses the ferroelectric 
5 liquid crystal as the light-addressed spatial light 
modulator 73, 705 will be described. From the 
operating principle and the initialization procedure, 
the liquid crystal light valve must be driven as 
follows. Basically, the writing light radiation time 

w during which the writing light is radiated onto the 
write plane of the liquid crystal light valve must 
overlap the write voltage application time for the 
liquid crystal light valve for at least a specified 
period of time. Where there are a number of liquid 

/5 crystal light valves connected in series, the drive 
voltage applied to respective liquid crystal light 
valves must be synchronized with the irradiation 
timing of the reading and writing light on the liquid 
crystal light valves. 

20 Figure 6 shows one example relationship be- 
tween the drive voltage applied to the light-ad- 
dressed spatial light modulators 73, 705 and the 
output light intensity of the laser 707 and laser 207 
that write on the light-addressed spatial light 

25 modulators. The process of writing the coordinate- 
converted images of the input and reference im- 
ages onto the light-addressed spatial light modula- 
tor 73 will be described later. Here let us suppose 
that these coordinate-converted images are radi- 

30 ated onto the write plane of the light-addressed 
spatial light modulator 73 at all times when the 
write pulse is applied to the spatial light modulator 
73. First, as shown in Figure 6(a), the light-ad- 
dressed spatial light modulator 73 is impressed 

35 with a drive voltage which consists of an erase 
pulse 750, a write pulse 757 and a zero voltage 
752, these appearing repetitively in that order. The 
image stored in the light-addressed spatial light 
modulator 73 is initialized and erased when applied 

40 with the erase pulse 750; an image being radiated 
onto the write plane is newly stored when applied 
with a write pulse 757; and the recorded image is 
read out during the zero voltage 752. This process 
is repeated. The erase pulse 750 and write pulse 

45 7 57 are the pulse voltages that satisfy the con- 
ditions described in the explanation of the operat- 
ing principle. 

With the above drive voltage applied, the light- 
addressed spatial light modulator 73 is recorded 

so with new binarized coordinate-converted intensity 
distribution images one after another. As shown in 
Figure 6(b), the output of the laser 107 is modu- 
lated so that the laser irradiation 753 during which 
the reading light is radiated onto the read plane of 

55 the light-addressed spatial light modulator 73 
matches the zero voltage state 752 of the drive 
voltage applied to the light-addressed spatial light 
modulator 73. This causes the new binarized 
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coordinate-converted intensity distribution images 
stored in the light-addressed spatial light modulator 
13 to be read out successively and the joint 
Fourier-transformed images are radiated onto the 
write plane of the light-addressed spatial light 
modulator 705 for the duration of trie laser irradia- 
tion 153 by the laser 101, Then, as shown in Figure 
6(c), the light-addressed spatial light modulator 105 
is applied with the write pulse 755 in synchronism 
with the laser irradiation period 753. Immediately 
before applying the write pulse 755, the erase 
pulse 154 is applied to initialize the light-addressed 
spatial light modulator 705. Immediately after the 
write pulse 755, there is a state of zero voltage 
156, allowing the image to be read out With the 
above process performed, the light-addressed spa- 
tial light modulator 705 is recorded successively 
with new binarized Fourier-transformed intensity 
distribution images. The recorded binarized 
Fourier-transformed intensity distribution images 
are read out as the correlation output images dur- 
ing the irradiation 757 of the laser 207, by synchro- 
nizing the zero voltage state 756 with the laser 
irradiation period 757, as shown in Figure 6(d). 

If the light-addressed spatial light modulators 
73, 705 do not have the light shielding layer 736 
and the dielectric mirror 737, the reading light 
influences the photoconductive layer 735. Making 
use of this fact, it is possible to lower the applied 
voltage of the erase pulse 750, 754. That is, if the 
reading light is irradiated not only during the period 
corresponding to the zero voltage 752, 756 but 
continues to be irradiated also during the period 
corresponding to the erase pulse 750, 754, the 
laser light is kept radiated also during the initializa- 
tion. Since the threshold voltages for the light- 
addressed spatial light modulators 73, 705 are low- 
er during the illumined state than during the dark 
state, the initialization can be performed even when 
the voltage level of the erase pulse 750, 754 is 
lowered. 

Where the light-addressed spatial light modula- 
tors have the light shielding layer 736 and the 
dielectric mirror 737 so that the effect of the read- 
ing light on the photoconductive layer 735 can be 
ignored, the modulation of the reading light as 
mentioned above is not necessary. In that case, it 
is still necessary to synchronize the zero voltage 
period 752 for the light-addressed spatial light 
modulator 73 with the write pulse 755 for the light- 
addressed spatial light modulator 705. 

By applying the above-mentioned drive volt- 
age, it is found that the light-addressed spatial light 
modulators 73, 705 can be operated at high speed 
of 30Hz to 2kHz. Since the image radiated onto the 
write plane is recorded in binary, it is possible to 
produce a precise image with little noise by adjust- 
ing the threshold level even when there are noise 



components so large as will otherwise mutilate the 
image. 

Next, we will explain about the electrically ad- 
dressed spatial light modulator 3 used in the above 

5 embodiment. As mentioned above, when the liquid 
crystal light valve, which employs a ferroelectric 
liquid crystal as the light-addressed spatial light 
modulators 73, 705, is used, operation at a very 
high speed of 30Hz-2kHz becomes possible. How- 

10 ever, when the liquid crystal television whose light 
modulating material is TN liquid crystal is used as 
the electrically addressed spatial light modulator 3, 
the operation is only possible at slow speed of 
around 30Hz. In that case, the operation speed of 

15 the pattern recognition apparatus of this invention 
is restricted by the speed of the electrically ad- 
dressed spatial light modulator 3. For increasing 
the operation speed of the electrically addressed 
spatial light modulator 3, it is preferable to use 

20 such light modulating materials as electro-optical 
ceramics like PLZT, magneto-optical materials like 
yttrium iron garnet and ferroelectric liquid crystal. 
This embodiment therefore uses the electrically 
addressed spatial light modulator 3 that uses the 

25 ferroelectric liquid crystal as the light modulating 
material. 

For the operation of the electrically addressed 
spatial light modulator 3, it is of course necessary 
to synchronize it with the operation of other spatial 

30 light modulator and laser, as with the light-ad- 
dressed spatial light modulator 73, 705. That is, to 
record the coordinate-converted images of the ref- 
erence image and input image displayed on the 
electrically addressed spatial light modulator 3 onto 

35 the light-addressed spatial light modulator 73, it is 
necessary to erase the image and write a new 
image on the electrically addressed spatial light 
modulator 3 during the zero voltage 752 and the 
erase pulse 750 of the drive voltage applied to the 

40 light-addressed spatial light modulator 73 and to 
hold the image displayed on the electrically ad- 
dressed spatial light modulator 3 while the write 
pulse 757 is applied. The method of driving each 
pixel on the electrically addressed spatial light 

45 modulator 3 employs an active system as repre- 
sented by a TFT (thin film transistor) system in 
which transistor is formed for each pixel and par- 
ticular transistors are activated. The moment the 
zero voltage period 752 starts, a signal for erasing 

so the image represented by the pixels on the elec- 
trically addressed spatial light modulator 3 is ap- 
plied, immediately followed by the application of 
image signals to each pixel to display a new im- 
age. In this way, the electrically addressed spatial 

55 light modulator 3 can be operated at high speed in 
synchronism with other spatial light modulators. 

In normal correlation processing that does not 
use coordinate conversion, when the input object is 
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rotated about 10 degrees with respect to the refer- 
ence object or is 20-30% different in size, the 
correlation peak intensity greatly decreases, mak- 
ing the precise recognition difficult. With this inven- 
tion, the coordinate conversion optical filter is used, 5 
which converts the image into the (Inr, B) coordi- 
nate system. This filter enables the input image to 
be identified for the rotating angle of up to 360 
degrees and the size change of up to 50%, as- 
suring invariable pattern recognition for input im- 10 
ages having rotation and size changes. It is also 
possible to determine the rotating angle and the 
size change based on the position where the cor- 
relation peak appears. Furthermore, where a co- 
ordinate conversion optical filter is used which con- is 
verts an image into other coordinate system, this 
invention permits an invariable pattern recognition 
for the coordinate-converted images having rotation 
and size changes. 

As to the recognition speed, when the spatial 20 
light modulator is used which employs a ferroelec- 
tric liquid crystal as the light modulating material 
and which can operate at 30Hz-2kHz, the pattern 
recognition apparatus can operate at high speed of 
around 30Hz-20kHz. 25 

Furthermore, since this invention employs a 
joint transform type correlator rather than a Vander- 
Lugt type, there is no need for developing the 
photographic plate or setting it after development, 
making the pattern recognition process simple. If 30 
reference objects are stored in the image memory 
device 43 beforehand, it is possible to change the 
reference object easily and quickly. Because this 
invention does not require a spatial light modulator 
with such high resolution as required by the photo- 35 
graphic plate, there is little effect of apparatus 
vibration and air movement on the display and the 
light axis of the optical system can easily be ad- 
justed. 

Figure 7 shows the configuration of other em- aq 
bodiment of the optical pattern recognition appara- 
tus having the coordinate conversion function. Con- 
stitutional elements having the identical functions 
with those of the embodiment of Figure 1 are 
assigned like reference numerals and their explana- 45 
tions are omitted or only brief explanations pro- 
vided. The optical coordinate converter has the 
same configuration with that of the previous em- 
bodiment. The points in which the joint transform 
correlator differs from the previous embodiment so 
include the following. A means for converting into 
coordinate-converted intensity distribution images 
the coordinate-converted images of the reference 
image and the input image obtained in the optical 
coordinate converter and for displaying the 55 
coordinate-converted intensity distribution images 
on the coordinate-converted image spatial light 
modulator consists of a photographing device 9, a 



mask 48 and an electrically addressed spatial light 
modulator. A means for converting the joint 
Fourier-transformed image into a Fourier-trans- 
formed intensity distribution image and displaying 
the Fourier-transformed intensity distribution image 
on a spatial light modulator consists of a photog- 
raphing device 106 and an electrically addressed 
spatial light modulator 1 07. 

The procedure up to the step of producing the 
coordinate-converted images of the input image 
and reference image on the Fourier transfer plane 
is the same as that shown in the embodiment of 
Figure 1 and its explanation is omitted here. The 
coordinate-converted images produced on the 
Fourier transfer plane are received by the photog- 
raphing device 9 where they are converted into 
electric signals. The electric signals are supplied to 
the electrically addressed spatial light modulator 
f4, which then displays the coordinate-converted 
intensity distribution images a specified distance L 
apart. The coherent light emitted from the laser 101 
is expanded by the beam expander 102 and radi- 
ated onto the electrically addressed spatial light 
modulator 14 to transform the coordinate-converted 
intensity distribution images into coherent images. 
These coherent images are Fourier-transformed by 
the lens 104 to form a joint Fourier-transformed 
image on the Fourier transfer plane. The joint 
Fourier-transformed image is received by the 
photographing device 106 where it is converted 
into electric signals. The electric signals are then 
fed to the electrically addressed spatial light 
modulator 107 to display a Fourier-transformed in- 
tensity distribution image of the joint Fourier-trans- 
formed image on the electrically addressed spatial 
light modulator 107. The coherent light emitted 
from the laser 201 is expanded by the beam ex- 
pander 202 and radiated onto the electrically ad- 
dressed spatial light modulator 107 to transform the 
Fourier-transformed intensity distribution image into 
a coherent image, which is further Fourier-trans- 
formed by the lens 204 to produce a correlation 
output image on the Fourier transfer plane of the 
lens. The processing after this is similar to that of 
the previous embodiment and its explanation omit- 
ted. 

For increasing the operation speed of the elec- 
trically addressed spatial light modulators T4, 707 
for coordinate conversion and the Fourier conver- 
sion, it is preferable to use such light modulating 
materials as electro-optical ceramics like PLZT, 
magneto-optical materials like yttrium iron garnet 
and ferroelectric liquid crystal, as with the elec- 
trically addressed spatial light modulator 3 of the 
previous embodiment. This embodiment therefore 
uses the electrically addressed spatial light 
modulators 14, 107 that uses the ferroelectric liquid 
crystal as the light modulating material. Since the 
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ferroelectric liquid crystal has a testability, the im- 
age displayed is usually binarized. Hence, the 
coordinate-converted intensity distribution image 
and Fourier-transformed intensity distribution image 
are displayed as a binarized coordinate-converted 
intensity distribution image and a binarized Fourier- 
transformed intensity distribution image. 

When electrically addressed spatial light 
modulators using the ferroelectric liquid crystal as 
the light modulating material are used for the elec- 
trically addressed spatial light modulators 14, 107, 
the electric signals output from the photographing 
devices 9, 106 need only be input as is to produce 
the binarized coordinate-converted intensity distri- 
bution image and binarized Fourier-transformed in- 
tensity distribution image. However, where normal 
electrically addressed spatial light modulators are 
employed, the electric signals must be binarized 
before being supplied to these electrically ad- 
dressed spatial light modulators since they display 
images in graded tone. 

This embodiment, too, can perform the invari- 
able pattern recognition at high speed for input 
images having rotational and size changes. 

In the preceding embodiments, there are only 
one reference image and one input image. When a 
number of images are to be identified, the refer- 
ence images must be replaced one after another, 
requiring time for pattern recognition. To solve this 
problem, it is being considered to provide a plural- 
ity of reference images so that the correlation pro- 
cessing with many reference images can be done 
at a time. Figure 8 shows one example arrange- 
ment of an input image and a plurality of reference 
images. A plurality of reference images are ar- 
ranged in a circle with the input image at the 
center. The coordinate conversion optical filter in 
the optical filter array 44, the coordinate conversion 
lens in the lens array 47 and the holes in the mask 
48 are arranged in positions corresponding to the 
reference image and the input image. This arrange- 
ment permits pattern recognition similar to the one 
performed in the above embodiments. It is noted 
here that since the plural number of reference 
images produces multiple pairs of correlation 
peaks, the corresponding number of light receiving 
elements 205 must be arranged at positions where 
the respective correlation peaks appear. While in 
the above description the reference image is pro- 
vided in plural numbers, the same effect can be 
obtained by using a plurality of input images and a 
single reference image. The following description 
takes a case of multiple reference images for ex- 
ample. 

When multiple reference images are used, the 
correlation peak intensities decrease and noise in- 
creases, substantially lowering the S/N ratio. To 
eliminate this drawback, the inventors are propos- 



ing a joint transform correlator having a feedback 
system. This is a common joint transform correlator 
added with a feedback system. The feedback sys- 
tem supplies to a linear or non-linear transfer func- 

5 tion two-dimensional correlation coefficients of at 
least one input image and at least one reference 
image, obtained by the correlation processing, and 
thereby virtually changes the intensity of light pass- 
ing through the reference images, which corre- 

10 spond to the correlation coefficients, according to 
the output of the transfer function. With this con- 
figuration, the pattern recognition with good S/N 
ratio is possible even when a plurality of reference 
images are used. 

15 In this invention, it is possible to add the 
above-mentioned feedback system. Figure 9 shows 
one example embodiment in which the feedback 
system is added to the optical pattern recognition 
apparatus having the coordinate conversion func- 

20 tion. The feedback section has the following con- 
figuration. A normalizing circuit for normalizing the 
correlation coefficients with, the maximum correla- 
tion coefficient consists of a feedback control cir- 
cuit 208. A mask spatial light modulator placed 

25 immediately before or after the object image spatial 
light modulator or the coordinate-converted image 
spatial light modulator is a feedback mask 207. A 
means for changing the transmission factor or re- 
flection factor for the corresponding portion of each 

30 reference image or each coordinate-converted in- 
tensity distribution image on the mask spatial light 
modulator in a linear or nonlinear relationship with 
the correlation coefficients normalized by the nor- 
malizing circuit, consists of a feedback control cir- 

35 cuit 208. The points in which this embodiment 
differs from the one of Figure 1 are that since 
multiple reference images are provided, the cor- 
responding coordinate conversion optical filter, co- 
ordinate conversion lens and the light receiving 

40 element have increased in number; that the feed- 
back mask 207 to change the intensity of the 
reading light irradiating the binarized coordinate- 
converted intensity distribution images is located 
immediately behind the light-addressed spatial light 

45 modulator 13 that records and displays the binariz- 
ed coordinate-converted intensity distribution im- 
ages; and that the feedback control circuit 208 is 
provided to control the feedback mask 207 accord- 
ing to the correlation coefficients from the iden- 

50 tification circuit 206. 

Next, the actual operation will be explained. 
The process of recording a plurality of binarized 
coordinate-converted intensity distribution images 
on the light-addressed spatial light modulator 13 

55 has already been described and is not given here. 
The coherent light emitted from the laser 101 , as in 
the case of Figure 1, is reflected by the polarizing 
beam splitter 703 and passes as the reading light 
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through the feedback mask 207 to radiate onto the 
read plane of the light-addressed spatial light 
modulator 13. In the initialized state, the feedback 
mask 207 is in a total transmissive state. The 
reflected light from the read plane passes again 5 
through the feedback mask 207 and then through 
the polarizing beam splitter 103. The light is then 
Fourier-transformed by the lens 104 to form a joint 
Fourier-transformed image on the light-addressed 
spatial light modulator 105 which memorizes the 10 
binarized Fourier-transformed intensity distribution 
image. It should be noted here that the reading 
light passes through the feedback mask 207 two 
times. That is, if the transmission factor of the 
feedback mask 207 is set at x, the binarized 1$ 
coordinate-converted intensity distribution image is 
equivalently masked by x 2 . The process for reading 
the stored binarized Fourier-transformed intensity 
distribution image to produce the correlation coeffi- 
cients is the same as shown in Figure 1, and its 20 
explanation is omitted. It is noted, however, that a 
plurality of correlation coefficients are sent from the 
identification circuit 206 to the feedback control 
circuit 208. 

The correlation coefficients corresponding to 25 
the reference images entered into the feedback 
control circuit 208 is normalized with the maximum 
correlation coefficient and then supplied to the 
feedback transfer function, which is preset before- 
hand or changed according to the result of the 30 
correlation processing, to determine the masking 
ratios for the reference images. According to the 
ratios, the transmission factor of a part of the 
feedback mask 207 corresponding to the binarized 
coordinate-converted intensity distribution image of 35 
each reference image is changed. The transmis- 
sion factor of course takes into consideration the 
fact that the light passes through the feedback 
mask 207 two times. In this condition, the similar 
correlation processing is repeated in the feedback 40 
loop. This feedback permits pattern recognition 
with a good S/N ratio even when the reference 
image used is plural in number. While in the above 
example, the feedback mask 207 is used to change 
the intensity of light irradiating the binarized 45 
coordinate-converted intensity distribution images, 
it is also possible to locate the feedback mask 
immediately before or after the electrically ad- 
dressed spatial light modulator 3 to change the 
intensity of light irradiating the original reference 50 
images. 

Various feedback transfer functions may be 
used. As linear or non-linear functions, there may 
be saturation type functions such as step functions 
and sigmoid functions or the combination of both. 55 
By changing the kind and shape of the feedback 
transfer function such as non-linearity and thresh- 
old value, the recognition capability of this pattern 



recognition apparatus of the invention is greatly 
changed. Hence, presetting an appropriate feed- 
back transfer function or changing the shape or 
kind of the feedback transfer function according to 
the result of the correlation processing permits the 
pattern recognition at higher speed and an im- 
proved S/N ratio. 

The areas of the reference image and input 
image themselves or the areas of the coordinate- 
converted intensity distribution images of these ref- 
erence and input images can be normalized by 
using the feedback mask 207 or other optical 
mask. When many reference images are used, 
there are different areas of reference images and 
input images or of their coordinate-converted inten- 
sity distribution images, so that a problem arises 
that the images with larger areas become easier to 
identify. For this reason, instead of the image 
areas, the quantities of light passing through or 
being reflected by the feedback mask are mea- 
sured. Based on the measured values, the feed- 
back mask 207 and other optical mask are con- 
trolled to change the intensity of light passing 
through or reflected by the mask which virtually 
represents the reference image and input image or 
their coordinate-converted intensity distribution im- 
ages. This makes equal the intensities of Fourier- 
transformed images of the coordinate-converted in- 
tensity distribution images. The normalizing is 
equivalent to making equal the intensities of the 
self correlation peaks of the reference images, and 
it is verified that the recognition capability using 
multiple reference images has improved whether 
the system has a feedback system or not. 

Figure 10 shows the configuration of another 
embodiment of the optical pattern recognition ap- 
paratus, according to this invention, which has the 
coordinate conversion function. This represents a 
system in which the input image and the reference 
image are displayed on a single light-addressed 
spatial light modulator. Components having iden- 
tical functions with those of the embodiment in 
Figure 1 are assigned like reference numerals, and 
their explanation is omitted or simplified. The pro- 
cessing performed after the coordinate-converted 
intensity distribution images are displayed on the 
light-addressed spatial light modulator 13 is the 
same as that already mentioned and its explanation 
omitted. The points in which the optical coordinate 
converter of this embodiment differs from the em- 
bodiment of Figure 1 are that the means for pro- 
ducing the two-dimensional reference image and 
input image consists of lenses 10, 30 and a beam 
splitter 46 and that at least one object image spa- 
tial light modulator that holds the reference image 
and the input image is a light-addressed spatial 
light modulator 11. 

The image of an input object / is focused by 
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the lens 70 and beam splitter 46 onto the write 
plane of the light-addressed spatial light modulator 
77 and is displayed as an input image on the 
modulator 11. Similarly, the image of a reference 
object 21 is focused by the lens 30 and beam 5 
splitter 46 onto the write plane of the light-ad- 
dressed spatial light modulator 11 and is displayed 
as a reference image on the modulator 11. The 
optical system is already adjusted so that the input 
image and the reference image are formed a sped- 10 
fied distance L apart. The configuration of the light- 
addressed spatial light modulator 77, which uses a 
reflection type liquid crystal light valve, will be 
described. 

The coherent light emitted from the laser 5 is 15 
expanded by the beam expander 6 and reflected 
by the polarizing beam splitter 72 and passes 
through the optical filter array 44 to irradiate the 
write plane of the light-addressed spatial light 
modulator 77, thereby converting the input image 20 
and the reference image into coherent images. The 
optical filter array 44 and the light-addressed spa- 
tial light modulator 77 are arranged close together. 
The coherent images then pass through the optical 
filter array 44 and the polarizing beam splitter 72 25 
and are Fourier-transformed by the lens array 47, 
forming the coordinate-converted intensity distribu- 
tion images on the light-addressed spatial light 
modulator 73. The processing after this is the same 
as that mentioned in the previous embodiment and 30 
hence its explanation omitted. 

Figure 11 shows the configuration of a further 
embodiment of the optical pattern recognition ap- 
paratus, according to this invention, which has the 
coordinate conversion function. This represents the 35 
method in which the reference image and the input 
image are displayed on separate light-addressed 
spatial light modulators so that they are coordinate- 
converted separately. Components having identical 
functions with those of the embodiment in Figure 1 40 
are assigned like reference numerals, and their 
explanation is omitted or simplified. The processing 
performed after the coordinate-converted intensity 
distribution images are displayed on the light-ad- 
dressed spatial light modulator 73 is the same as 45 
that already mentioned and its explanation omitted. 
The points in which the optical coordinate conver- 
ter of this embodiment differs from the embodi- 
ment of Figure 1 are that the means for producing 
the two-dimensional reference image and input im- 50 
age consists of lenses 70, 30; that at least one 
coherent light source consists of the laser 5, beam 
expander 6, polarizing beam splitter 72, laser 25, 
beam expander 26 and polarizing beam splitter 32; 
that at least one object image spatial light modula- 55 
tor that holds the reference image and the input 
image is a light-addressed spatial light modulators 
77, 37; at least one coordinate conversion optical 



filter put close to the object image spatial light 
modulator is optical filters 4, 24; and at least one 
lens is lenses 7, 27. 

The image of an input object 7 is focused by 
the lens 70, through the optical filter 4 located 
immediately before the light-addressed spatial light 
modulator 77, onto the write plane of the light- 
addressed spatial light modulator 77 and is dis- 
played on it as the input image. Similarly, the 
image of a reference object 27 is focused by the 
lens 30, through the optical filter 24 put imme- 
diately before the light-addressed spatial light 
modulator 37, onto the write plane of the light- 
addressed spatial light modulator 37 and is dis- 
played on it as the reference image. The reference 
image and the input image are displayed on the 
light-addressed spatial light modulators 77, 37 as 
images superimposed with the coordinate conver- 
sion optical filter. When the input image and the 
reference image are to be displayed on the light- 
addressed spatial light modulators 77, 37, it is 
possible to display the coordinate conversion op- 
tical filter superimposed on these images or, as in 
the previous embodiment, to let the input image 
and the reference image pass through the coordi- 
nate conversion optical filter when reading the input 
and reference images. 

The coherent beams emitted from the lasers 5, 

25 are each expanded by the beam expanders 6, 

26 and reflected by the polarizing beam splitters 
72, 32 to irradiate the read plane of the light- 
addressed spatial light modulators 77, 37. As a 
result, the reference image and the input image are 
read out and converted into coherent images. The 
coherent images are Fourier-transformed by the 
lenses 7, 27, pass through the beam splitter 46 and 
are removed of unwanted dc bias components by 
the mask 48 and then only the coordinate-con- 
verted intensity distribution images are displayed a 
certain distance L apart on the light-addressed spa- 
tial light modulator 73. The processing performed 
after the coordinate-converted intensity distribution 
images are displayed on the light-addressed spatial 
light modulator 73 is the same as that of the 
previous embodiment and thus its explanation and 
drawings are omitted. 

Figure 12 shows the configuration of a further 
embodiment of the optical pattern recognition ap- 
paratus, according to this invention, which has the 
coordinate conversion function. This represents the 
method in which the reference image and the input 
image are displayed on separate electrically ad- 
dressed spatial light modulators so that they are 
coordinate-converted separately and their 
coordinate-converted intensity distribution images 
are electrically combined. Components having 
identical functions with those of the embodiment in 
Figure 7 are assigned like reference numerals, and 
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their explanation is omitted or simplified. The pro- 
cessing performed after the coordinate-converted 
intensity distribution images are electrically com- 
bined is the same as that mentioned in the em- 
bodiment of Figure 7 and its explanation omitted. 
The optical coordinate converter of {his embodi- 
ment has the following configuration. A means for 
producing two-dimensional reference image and in- 
put image consists of photographing devices 2, 22; 
at least one coherent light source consists of the 
laser 5, beam expander 6, laser 25, and beam 
expander 26; at least one object image spatial light 
modulator that holds the reference image and the 
input image is an electrically addressed spatial 
light modulators 3, 23; at least one coordinate 
conversion optical filter put close to the object 
image spatial light modulator is optical filters 4, 24\ 
and at least one lens is lenses 7, 27. The point in 
which the joint transform correlator differs from the 
previous embodiment is as follows. A means for 
converting into coordinate-converted intensity dis- 
tribution images the coordinate-converted images 
of the reference image and the input image ob- 
tained in the optical coordinate converter and for 
displaying the coordinate-converted intensity dis- 
tribution images on the coordinate-converted image 
spatial light modulator consists of a mask 8, 
photographing device 9, mask 26, photographing 
device 29, image processing device 41, and elec- 
trically addressed spatial light modulator 14. 

An input object 1 and a reference object 21 are 
photographed by separate photographing devices 
2, 22 and displayed as an input image and a 
reference image on the electrically addressed spa- 
tial light modulators 3, 23. The coherent beams 
emitted from the lasers 5, 25 are each expanded 
by the beam expanders 6, 26 to irradiate the elec- 
trically addressed spatial light modulators 3, 23. As 
a result, the reference image and the input image 
displayed are converted into coherent images. The 
coherent images pass through the optical filters 4, 
24 put immediately after the electrically addressed 
spatial light modulators 3, 23 and are then Fourier- 
transformed by the lenses 7, 27 to produce 
coordinate-converted images on the Fourier trans- 
fer plane. The masks 8, 28 are provided directly in 
front of the Fourier transfer plane to mask out 
unwanted dc bias components to allow only the 
necessary coordinate-converted images to pass 
through. The coordinate-converted images thus ob- 
tained are received by separate photographing de- 
vices 9, 29, which then convert them into electric 
signals. The electric signals are fed to the image 
processing device 41 where they are synthesized 
or combined. The synthesized signal is then sup- 
plied to the electrically addressed spatial light 
modulator 14, which displays the coordinate-con- 
verted intensity distribution images a specified dis- 



tance L apart, as shown in Rgure 4. The process- 
ing after this step is the same as described in the 
previous embodiment of Rgure 7 and thus its ex- 
planation is omitted. 
5 Rgure 13 shows the configuration of a further 

embodiment of the optical pattern recognition ap- 
paratus, according to this invention, which has the 
coordinate conversion function. Components having 
identical functions with those of the embodiment in 

w Rgure 7 are assigned like reference numerals, and 
their explanation is omitted or simplified. The op- 
tical coordinate converter of this embodiment is the 
same as the one shown in Rgure 7. The point in 
which the joint transform correlator differs from the 

15 previous embodiment is as follows. A means for 
converting into coordinate-converted intensity dis- 
tribution images the coordinate-converted images 
of the reference image and the input image ob- 
tained in the optical coordinate converter and for 

20 displaying the coordinate-converted intensity dis- 
tribution images on the coordinate-converted image 
spatial light modulator consists of a mask 48, 
photographing device 9, image selector device 52, 
image memory device 43, and electrically ad- 

25 dressed spatial light modulator 14. A means for 
converting into coherent images the coordinate- 
converted intensity distribution images displayed 
on the coordinate-converted image spatial light 
modulator consists of a laser 101 and a beam 

30 expander 102. A means for Fourier-transforming 
the coherent images by the lens to produce a joint 
Fourier-transformed image of the coordinate-con- 
verted intensity distribution images is a lens 104. A 
means for Fourier-transforming the joint Fourier- 

35 transformed image into a Fourier-transformed in- 
tensity distribution image and displaying the 
Fourier-transformed intensity distribution image on 
the Fourier-transformed image spatial light modula- 
tor, consists of a photographing device 106, image 

40 selector device 52, image memory device 43 and 
electrically addressed spatial light modulator 14. A 
means for reading the Fourier-transformed intensity 
distribution image displayed on the Fourier-trans- 
formed image spatial light modulator by using the 

45 coherent light consists of a laser 101 and a beam 
expander 102. A means for Fourier-transforming 
again by the lens the Fourier-transformed intensity 
distribution image thus read out to produce a cor- 
relation output image and for converting the cor- 

50 relation output image into a correlation signal by a 
photographing device or light receiving element, 
consists of a lens 104, photographing device 106 
and image selector device 52. A means for pro- 
cessing the correlation signal to determine two- 

55 dimensional correlation coefficients of the reference 
image and the input image is an identification cir- 
cuit 206. 

The succeeding processing up to the step 
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where the coordinate-converted images are re- 
ceived by the photographing device 9 is the same 
as in the embodiment of Figure 7, and its explana- 
tion is omitted. The image selector device 52 of 
this embodiment cuts off or changes over its input 
and output electric signals. The electric signal out- 
put from the photographing device 9 is supplied 
through the image selector device 52 and image 
memory device 43 into the electrically addressed 
spatial light modulator 74 to display the coordinate- 
converted intensity distribution images a specified 
distance L apart on the electrically addressed spa- 
tial light modulator 74. The coherent beam emitted 
from the laser 101 is expanded by the beam ex- 
pander 102 to irradiate the electrically addressed 
spatial light modulator 14. As a result, the 
coordinate-converted intensity distribution images 
are converted into coherent images, which are then 
Fourier-transformed by the lens 104 to form the 
joint Fourier-transformed image on the Fourier 
transfer plane. The joint Fourier-transformed image 
is received by the photographing device 106, which 
converts it into an electric signal. The electric sig- 
nal is supplied through the image selector device 
52 to the image memory device 43. At this time, 
the electric signal from the photographing device 9 
is blocked by the image selector device 52 from 
being output to the image memory device 43. The 
signal from the photographing device 106 is stored 
in the image memory device 43, from which it is 
fed to the electrically addressed spatial light 
modulator 74, thus displaying the Fourier-trans- 
formed intensity distribution image of the joint 
Fourier-transformed image. The Fourier-trans- 
formed intensity distribution image is Fourier-trans- 
formed in the same way as the coordinate-con- 
verted intensity distribution image to produce a 
correlation output image. The correlation output 
image is received by the photographing device 106 
which converts it into a correlation signal. The 
image selector device 52 now outputs the correla- 
tion signal to the identification circuit 206, which 
measures the correlation peak intensity to produce 
a correlation coefficient. This embodiment has the 
advantage of having fewer components in the op- 
tical system than in the embodiment of Figure 7. 

Figure 14 shows the configuration of a further 
embodiment of the optical pattern recognition ap- 
paratus, according to this invention, which has the 
coordinate conversion function. Components having 
identical functions with those of the embodiment in 
Figure 12 are assigned like reference numerals, 
and their explanation is omitted or simplified. The 
optical coordinate convertor of this embodiment is 
the same as the one shown in Figure 12. The point 
in which the joint transform correlator differs from 
the previous embodiment is as follows. A means 
for converting into coordinate-converted intensity 



distribution images the coordinate-converted im- 
ages of the reference image and the input image 
obtained in the optical coordinate convertor and for 
displaying the coordinate-converted intensity dis- 

5 tribution images on the coordinate-converted image 
spatial light modulator consists of a mask 8, light- 
addressed spatial light modulator 13, mask 28, and 
light-addressed spatial light modulator 33. A means 
for converting into coherent images the coordinate- 

w converted intensity distribution images displayed 
on the coordinate-converted image spatial light 
modulator consists of a laser 101, a beam ex- 
pander 102, a mirror 108, a light beam splitter 703, 
a mirror 110 and a polarizing beam splitter 723. A 

75 means for Fourier-transforming the coherent im- 
ages by the lens to produce a joint Fourier-trans- 
formed image of the coordinate-converted intensity 
distribution images is a beam splitter 709 and a 
lens 704. A means for Fourier-transforming the joint 

20 Fourier-transformed image into a Fourier-trans- 
formed intensity distribution image and displaying 
the Fourier-transformed intensity distribution image 
on the Fourier-transformed image spatial light 
modulator, consists of a light-addressed spatial 

25 light modulator 705. The processing after this step 
is the same as that of the previous embodiment 
and its explanation is omitted. 

The succeeding processing up to the steps 
where the coordinate-converted images of the input 

30 image and the reference image are formed on the 
Fourier transfer plane is the same as in the em- 
bodiment of Figure 12. The coordinate-converted 
images on the Fourier-transfer plane are removed 
of unwanted dc bias components by the masks 8, 

35 28 and radiated onto the write plane of the light- 
addressed spatial light modulators 73, 33 to display 
the coordinate-converted intensity distribution im- 
ages on the light-addressed spatial light modulators 
73, 33. The coherent beam emitted from the laser 

40 101 is expanded by the beam expander 702, re- 
flected by the mirror 708 and split into two beams 
by the polarizing beam splitter 703. One of the split 
beams irradiates, as the reading light, the read 
plane of the light-addressed spatial light modulator 

45 73, while the other beam is reflected by the mirror 
770 and the polarizing beam splitter 723 to radiate 
the read plane of the light-addressed spatial light 
modulator 33. As a result, the coordinate-converted 
intensity distribution images are converted into co- 

50 herent images, which are then Fourier-transformed 
by the lens 704, via the polarizing beam splitters 
703, 723 and the beam splitter 709. to form the 
joint Fourier-transformed image on the Fourier 
transfer plane. By throwing the joint Fourier-trans- 

55 formed image onto the write plane of the light- 
addressed spatial light modulator 705, the Fourier- 
transformed intensity distribution image is dis- 
played on the light-addressed spatial light modula- 
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tor 105. The processing that follows is the same as 
with other embodiments and its explanation is omit- 
ted. 

When there is a difference in size and kind 
between the input image and the reference image, 
it may become impossible to perfoVm accurate 
pattern recognition due to variations in light inten- 
sity of the coordinate-converted images. To over- 
come such a drawback, the light intensity of the 
coordinate-converted image is optimized to enable 
more precise pattern recognition. One such em- 
bodiment is shown in Figure 15. An automatic light 
regulator has the following configuration. A means 
for measuring the light intensity or the change of 
light intensity of the coordinate-converted image, 
joint Fourier-transformed image or correlation out- 
put image consists of a light intensity measuring 
beam splitter 45 and a light receiving element array 
49. A means for changing the light intensity ac- 
cording to the light intensity or changes of light 
intensity or a means for changing the light recep- 
tion sensitivity of the coordinate-converted image 
spatial light modulator, Fourier-transformed image 
spatial light modulator, photographing device or the 
light receiving element consists of a light intensity 
regulator 50 and a liquid crystal mask 57. 

The method of producing the coordinate-con- 
verted images and the processing thereafter are 
the same as those for other embodiments, and 
thus their explanation is omitted. A part of the light 
quantities of the coordinate-converted images is 
divided by the light intensity measuring beam split- 
ter 45 and radiated onto the light receiving element 
49. The light receiving elements on the light receiv- 
ing element array 49 are arranged at positions 
corresponding to the associated coordinate-con- 
verted images. Based on the outputs from the 
respective light receiving elements, the light inten- 
sity or the rate of change of light intensity of the 
coordinate-converted images can be measured. 
The output is entered into the light intensity regula- 
tor 50 located immediately before or after the elec- 
trically addressed spatial light modulator 13 to op- 
erate the liquid crystal mask so that the light inten- 
sities of the coordinate-converted images are equal 
or they are optimal to the light reception sensitivity 
of the light-addressed spatial light modulator 13. 
That is, by changing the transmission factor of 
parts of the liquid crystal mask 51 that correspond 
to the input image and the reference image, the 
light intensities of the coordinate-converted images 
are made equal. With this method, the light inten- 
sities of the coordinate-converted images become 
equal, enabling accurate pattern recognition even 
when the size and kind of the reference image and 
the input image vary. Similar effects can be ob- 
tained by using the electrically addressed spatial 
light modulator 3 instead of the liquid crystal mask 



51. 

The accurate pattern recognition is also possi- 
ble by optimizing the light intensities of the joint 
Fourier-transformed image and the correlation out- 

5 put image. 

A problem that may arise from performing the 
above optical coordinate conversion is that since 
the shift invariability is lost, the correct pattern 
recognition becomes impossible when the input 

io image is moved parallelly. For example, in a nor- 
mal pattern recognition apparatus of VanderLugt 
type that does not perform the optical coordinate 
conversion, let us consider a case where the direc- 
tion and size of the input image are the same as 

rs those of the reference image. As mentioned earlier, 
since the characteristic of the Fourier transform 
provides shift invariability, accurate recognition is 
assured even when the position on the object plane 
of the input image differs from (is parallelly moved 

20 from) the position of the reference image that ex- 
isted when the matched filter was made. In the 
pattern recognition apparatus that perform the op- 
tical coordinate conversion as shown in Figure 3, 
when the position of the input image displayed on 

25 the liquid crystal television 303 is different from 
and parallelly moved from the position of the refer- 
ence image that existed during the making of the 
matched filter, the relative positional relationship 
between the coordinate conversion optical filter 304 

30 and the reference image and input image changes. 
As a result, the coordinate-converted image of the 
reference image differs in shape from that of the 
input image. For this reason, it is not possible to 
perform accurate recognition by using such 

35 coordinate-converted images. This also applies ei- 
ther to the VanderLugt type of the correlator as 
shown in Figure 3 or to the joint transform type of 
the correlator. 

To eliminate this problem, the optical coordi- 

40 nate converter performs preprocessing— which 
transforms the reference image and the input im- 
age by electronic or optical means so that they are 
shift-invariable— and then performs a desired op- 
tical coordinate conversion on the shift-invariable 

45 intensity distribution image so that the image will 
be invariable to the rotational and size changes. 
This ensures a pattern recognition, which is invari- 
able not only for the rotation and size change but 
also for shifts. The following procedure will be 

so taken for transforming the images so that they are 
optically shift-invariable. First, the input image and 
the reference image are Fourier-transformed by 
using coherent light. As a result, even when the 
input image displayed is parallelly moved on the 

55 spatial light modulator, only the phase component 
of the Fourier-transformed image changes because 
of the characteristic of the Fourier transform and no 
change occurs in the intensity distribution. The 
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Fourier-transformed intensity distribution image 
(shift-invariable intensity distribution image) is sub- 
jected to a desired optical coordinate conversion 
and to the correlation processing so as to be shift- 
invariable. 5 

The method of electronically making the image 
shift-invariable involves calculating the center of 
gravity of the reference image and the input image 
by computer and performing computer image pro- 
cessing so that the gravity centers of the images w 
assume specified positions on the shift-invariable 
image spatial light modulator at all times. As a 
result, the relative positional relationship between 
the reference image and the corresponding coordi- 
nate conversion opticaJ filter is always the same as is 
that between the input image and the coordinate 
conversion optical filter. By performing a desired 
optical coordinate conversion on the images pro- 
cessed as described above and then subjecting the 
images to the correlation processing, the result of 20 
the correlation processing becomes shift-invariable. 

Figure 16 shows the configuration of a further 
embodiment of the optical pattern recognition ap- 
paratus, according to this invention, which has the 
coordinate conversion function. 25 

The optical coordinate convertor of this em- 
bodiment has the following configuration. At least 
one coherent light source consists of a laser 467, 
beam expander 462, laser 405, beam expander 
406, and polarizing beam splitter 472. A means for 30 
obtaining two-dimensional reference image and in- 
put image consists of a photographing device 402, 
image processing device 442 and image memory 
device 43. A means for optically or electronically 
converting the reference image and the input im- 35 
age so that they are shift-invariable and then dis- 
playing these shift-invariable images on at least 
one shift-invariably transformed image spatial light 
modulator, consists of an electrically addressed 
spatial fight modulator 403, lens array 464 and 40 
light-addressed spatial light modulator 465. At least 
one coordinate conversion optical filter put close to 
the shift-invariably transformed image spatial light 
modulator is a filter array 44. AMeast one lens is a 
lens array 47. 45 

A joint transform correlator has the following 
configuration. A means for converting into 
coordinate-converted intensity distribution images 
the coordinate-converted images of the reference 
image and the input image obtained in the optical 50 
coordinate convertor and for displaying the 
coordinate-converted intensity distribution images 
on the coordinate-converted image spatial light 
modulator, consists of a mask 48 and an light- 
addressed spatial light modulator 473. A means for 55 
converting the coordinate-converted intensity dis- 
tribution images displayed on the spatial light 
modulator 473 into coherent images consists of a 



laser 707, a beam expander 702, and a polarizing 
beam splitter 703. A means for Fourier-transform- 
ing the coherent images by using a lens and pro- 
ducing a joint Fourier-transformed image of the 
coordinate-converted intensity distribution images 
consists of a lens 704. A means for converting the 
joint Fourier-transformed image into a Fourier- 
transformed intensity distribution image and dis- 
playing the Fourier-transformed intensity distribu- 
tion image on a Fourier-transformed image spatial 
light modulator consists of a light-addressed spatial 
light modulator 705. A means for reading by the 
coherent light the Fourier-transformed intensity dis- 
tribution image displayed on the Fourier-trans- 
formed image spatial light modulator 705 consists 
of a laser 207, a beam expander 202 and a polariz- 
ing beam splitter 203. A means for Fourier-trans- 
forming again the Fourier-transformed intensity dis- 
tribution image thus read out by using a lens to 
produce a correlation output image and then con- 
verting the correlation output image into a correla- 
tion signal by using a photographing device or a 
light receiving element, consists of a lens 204 and 
a light receiving element 205. A means for pro- 
cessing the correlation signal to determine two- 
dimensional correlation coefficients of the reference 
image and the input image consists of an iden- 
tification circuit 206. 

First, the reference object, database of a refer- 
ence for pattern recognition, is placed at a position 
of an input object 7 and photographed by a 
photographing device 402 to produce a two-dimen- 
sional reference image. The two-dimensional refer- 
ence image is then stored via an image processor 
442 into an image memory device 43. Likewise, an 
input object 7, which is to be identified, is photo- 
graphed by the photographing device 402 to pro- 
duce a two-dimensional input image. The input 
image and the reference image, the latter being 
stored in the image memory device 43, are syn- 
thesized by the image processor 442 and dis- 
played on an electrically addressed spatial light 
modulator 403. Where the input object 7 that 
changes its position with time is to be recognized, 
the input image displayed on the electrically ad- 
dressed spatial light modulator 403 also changes 
its position as the input object 7 moves. In order 
that the reference image and the input image do 
not overlap in such a case, these images are 
formed separate as shown in Figure 4. As the input 
object 7 moves, it is needless to say that the 
positional relationship such as a distance between 
the reference image and the input image also 
changes. 

The coherent light emitted from the laser 467 
is expanded by a beam expander 462 into a 
parallel-ray beam of a specified diameter and then 
radiated onto the electrically addressed spatial light 
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modulator 403 on which the input image and the 
reference image are displayed. Then, these images 
are converted into coherent images. The coherent 
images are Fourier-transformed by each shift-in- 
variable lens of the lens array 464 to produce a 
Fourier-transformed image as a shift-invariable im- 
age on the Fourier transfer plane. The shift-invari- 
able lenses on the lens array 464 correspond to 
the input image and the reference image displayed 
on the electrically addressed spatial light modulator 
403. The lenses are a specified distance L apart. 

Placed on the Fourier transfer plane where the 
Fourier-transformed image is obtained are a light- 
addressed spatial light modulator 465 and a filter 
array 44 immediately in front of the modulator 465. 
In this arrangement, the Fourier-transformed im- 
ages of the reference and input images superim- 
posed with the coordinate conversion optical filter 
are radiated onto the write plane of the light-ad- 
dressed spatial light modulator 465. As a result, the 
Fourier-transformed images of the input and refer- 
ence images superimposed with the coordinate 
conversion optical filter are converted into intensity 
distributions and displayed as the shift-invariably 
transformed images a distance L apart on the light- 
addressed spatial light modulator 465. There are 
many kinds of light-addressed spatial light modula- 
tors 465. In this embodiment, the configuration that 
employs the reflection type liquid crystal light valve 
using a ferroelectric liquid crystal as the light mod- 
ulating material will be explained. The electrically 
addressed spatial light modulator 403 is placed on 
the front focal plane of the lens array 464. On the 
rear focal plane the light-addressed spatial light 
modulator 465 and the optical filter array 44 are put 
close together. 

The optically filter array 44 consists of two 
coordinate conversion optical filters— made by the 
computer-synthesized hologram as already men- 
tioned—placed a specified distance L apart at posi- 
tions corresponding to the shift-invariable lenses. In 
the coordinate conversion process, if images to be 
converted are not in the same positional relation- 
ship with respect to the coordinate conversion op- 
tical filter, the conversion will produce different 
coordinate-converted images even when the same 
image is coordinate-converted. For this reason, the 
distance between the two coordinate conversion 
optical filters must be equal to the distance L 
between the Fourier-transformed images (equal to 
the distance between the shift-invariable lenses). 
The coordinate conversion optical filters are ar- 
ranged so that the relative positional relationships 
between the Fourier-transformed images of the in- 
put and reference images and the coordinate con- 
version optical filters are equal. With this arrange- 
ment, if the position of the input image is moved 
parallelly on the electrically addressed spatial light 



modulator 403 as shown in Rgure 19, the intensity 
distribution of the Fourier-transformed image does 
not change at all although its phase changes. 
Hence, the relative positional relationship between 

5 the Fourier-transformed image of the input image 
and the corresponding coordinate conversion op- 
tical filter does not change, so that its coordinate- 
converted image remain unchanged. 

The coherent light emitted from the laser 405 

w is expanded by a beam expander 406 into a 
parallel-ray beam of a specified diameter and then 
reflected by a polarizing beam splitter 412 to ra- 
diate onto the read plane of the light-addressed 
spatial light modulator 465 as the reading light. The 

15 polarizing direction of the reading light is aligned 
beforehand with the alignment direction of the liq- 
uid crystal molecules (or aligned with a direction 
perpendicular to it), in which direction the liquid 
crystal molecules are aligned by initialization of the 

20 spatial light modulator 465. By passing the reading 
light— which was reflected by the light-addressed 
spatial light modulator 465— through a detector 
whose polarizing axis is set perpendicular or par- 
allel to the polarization direction of the reading 

25 light, the image displayed on the light-addressed 
spatial light modulator 465 can be read out as a 
positive image or a negative image. In this embodi- 
ment, a polarizing beam splitter 412 is used as a 
detector. 

30 In this way, the shift-invariable intensity dis- 
tribution images of the input image and the refer- 
ence image are converted into coherent images. 
These coherent images are Fourier-transformed by 
the coordinate conversion lenses of the lens array 

35 47. As a result, coordinate-converted images that 
are converted into a desired coordinate system are 
formed on the Fourier transfer planes. A mask 48 
placed immediately before the light-addressed spa- 
tial light modulator 413 are formed with holes to 

40 allow only the + first order coordinate-converted 
images to pass through. This cuts off unwanted dc 
bias components and high-order coordinate-con- 
verted images, and only the necessary coordinate- 
converted images, which represent the shift-invari- 

46 able intensity distribution images of the reference 
and input images, pass through the mask to radiate 
onto the write plane of the light-addressed spatial 
light modulator 41 3. The coordinate-converted im- 
ages, which represent the shift-invariable intensity 

so distribution images of the input and reference im- 
ages, are converted into coordinate-converted in- 
tensity distribution images, which are displayed a 
distance L apart on the light-addressed spatial light 
modulator 413. There are many kinds of light- 

55 addressed spatial light modulator 413. In this em- 
bodiment, the light-addressed spatial light modula- 
tor, like the light-addressed spatial light modulator 
465, employs a reflection type liquid crystal light 
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valve which uses a ferroelectric liquid crystal as the 
light modulating material. 

On the front focal plane of the lens array 47 is 
located the light-addressed spatial light modulator 
465. On the rear focal plane is positioned the light- 5 
addressed spatial light modulator 413. The coordi- 
nate conversion lenses of the lens array 47, as with 
the coordinate conversion optical filters, are ar- 
ranged a distance L apart at positions that cor- 
respond to the two shift-invariable intensity distribu- w 
tion images being converted. The processing that 
follows is the same as the one described in the 
embodiment of Figure 1 and thus its explanation is 
omitted. 

For strict Fourier transform, it is preferred that /5 
the image to be Fourier-transformed be put on the 
front focal plane of each Fourier transform lens or 
between the lens and its rear focal plane. Then the 
Fourier-transformed image is formed on the rear 
focal plane of the lens. In this embodiment, there- 20 
fore, the image is placed on the front focal plane of 
the lens array 464, 47 and lens 104, 204 and the 
Fourier-transformed image is received on the rear 
focal plane. 

In the above embodiment, the optical filter ar- 25 
ray 44 is placed immediately before the light-ad- 
dressed spatial light modulator 465. The Fourier- 
transformed images of the reference image and the 
input image superimposed with the coordinate con- 
version optical filter are transformed into intensity 30 
distributions, which are displayed as the shift-in- 
variable intensity distribution images on the light- 
addressed spatial light modulator 465. The optical 
filter array 44 may be located immediately after the 
light-addressed spatial light modulator 465 (on the 35 
read plane side) rather than immediately before it 
(on the write plane side). In that case, the Fourier- 
transformed images not superimposed with the co- 
ordinate conversion optical filter are transformed 
into intensity distributions, which are displayed as 40 
the shift-invariable intensity distribution images on 
the light-addressed spatial light modulator 465. The 
reading light passes through the coordinate conver- 
sion optical filter array 44 two times. 

When as in the above embodiment the Fourier- 45 
transformed images superimposed with the coordi- 
nate conversion optical filter are transformed into 
intensity distributions, the coordinate conversion 
optical filter must be of the amplitude modulation 
type. However, when the optical filter array is ar- so 
ranged immediately after the light-addressed spa- 
tial light modulator 465, the coordinate conversion 
optical filter may be either of the amplitude modu- 
lation type or phase modulation type. 

Where there are a number of light-addressed 55 
spatial light modulators connected in series to 
record and read images successively, the writing, 
erasing and reading of images to and from the 



light-addressed spatial light modulator must be 
synchronized with each other. In the case of the 
liquid crystal light valve using a ferroelectric liquid 
crystal in this embodiment, the write pulse and 
erase pulse applied to the liquid crystal light valves 
and the reading light and writing light application 
times should be synchronized so that the duration 
in which the writing light is radiated onto the write 
plane of the liquid crystal light valve and the time 
during which the write voltage is applied to the 
liquid crystal light valve overlap for at least a speci- 
fied period. With such a drive method, the light- 
addressed spatial light modulators 465, 413, 105 
can be driven at high speed of 30Hz-2kHz. 

Next, let us explain about the electrically ad- 
dressed spatial light modulator 403 used in the 
above embodiment. The operation of the electri- 
cally addressed spatial light modulator 403, too, 
must be synchronized with other spatial light 
modulators and lasers, as in the case of the light- 
addressed spatial light modulators 465, 105, In this 
embodiment, therefore, an electrically addressed 
spatial light modulator using a ferroelectric liquid 
crystal as the light modulating material is used for 
the electrically addressed spatial light modulator 
403. This permits the electrically addressed spatial 
light modulator 403 to be operated at high speed in 
synchronism with other spatial light modulators. 

In this embodiment, a coordinate conversion 
optical filter is used, which converts the image into 
the (Inr, $) coordinate system. This filter enables 
the input image to be identified for the rotating 
angle of up to 360 degrees and the size change of 
up to 50%, assuring invariable pattern recognition 
for input images having rotation and size changes, 
as in the first embodiment. It is also possible to 
determine the rotating angle and the size change 
based on the position where the correlation peak 
appears. Furthermore, where a coordinate conver- 
sion optical filter is used which converts an image 
into other coordinate system, this invention permits 
an invariable pattern recognition for the coordinate- 
converted images having rotation and size 
changes. 

This embodiment ensures a pattern recogni- 
tion, which is invariable not only for the rotation and 
size change but also for shifts. In this embodiment, 
when a reference image and an input image as 
shown in Figure 4 are considered, the reference 
image is stored in the image memory device 43, so 
that the image position on the electrically ad- 
dressed spatial light modulator 403 remains un- 
changed. As shown in Figure 19, the input image 
changes its position on the electrically addressed 
spatial light modulator 403 as the input object 1 
moves. However, since, as mentioned earlier, the 
input image is made shift-invariable by the 
preprocessing before the coordinate conversion, 
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the intensity distribution of the Fourier-transformed 
image (shift-invariable intensity distribution image) 
does not change even when the position of the 
input image is changed by the Fourier transform. 
Hence, the relative positional relationship between 5 
each shift-invariable intensity distribution image 
and the corresponding coordinate conversion op- 
tical filter remains unchanged, so that their 
coordinate-converted images do not change, mak- 
ing the results of the correlation processing invari- 10 
able for shifts of the input image. It is obvious that 
the invariable correlation processing is possible 
also when the reference image is changed and its 
position shifted. 

When the input object 1 moves through a 15 
three-dimensional space, the size, direction and 
position of the input image on the electrically ad- 
dressed spatial light modulator 403 change. By 
using an appropriate coordinate conversion optical 
filter, it is possible to perform accurate pattern 20 
recognition on the input image as the object 
moves. 

As to the recognition speed, when the spatial 
light modulator is used which employs a ferroelec- 
tric liquid crystal as the light modulating material 25 
and which can operate at 30Hz-2kHz, the pattern 
recognition apparatus can operate at high speed of 
around 30Hz-20kHz. 

Figure 17 shows the configuration of a further 
embodiment of the optical pattern recognition ap- 30 
paratus, according to this invention, which has the 
coordinate conversion function. This represents a 
system which employs an electrically addressed 
spatial light modulator instead of a light-addressed 
spatial light modulator 465. The joint transform 35 
correlator is the same as that shown in Figure 16 
and its drawing is omitted. The components having 
functions identical with those of the embodiment of 
Figure 16 are given like reference numerals and 
their explanation omitted or simplified. aq 

The optical coordinate converter of this em- 
bodiment differs from the embodiment of Figure 16 
in the following respects. A means is provided for 
optically or electronically converting the reference 
image and the input image into shift-invariable im- 45 
ages and then displaying the shift-invariable im- 
ages on at least one shift-invariable image spatial 
light modulator. This means consists of an elec- 
trically addressed spatial light modulator 403, a 
lens array 464, a photographing device 466, a so 
binarizing circuit 467, and an electrically addressed 
spatial light modulator 466. 

The reference image and the input image dis- 
played on the electrically addressed spatial light 
modulator 403 are Fourier-transformed in a way 55 
similar to that shown in Figure 16. The Fourier- 
transformed images are directly entered into the 
photographing device 466 where they are con- 



verted into image signals. The image signals are 
binarized by a binarizing circuit 467 and fed to the 
electrically addressed spatial light modulator 468 
where the Fourier-transformed images of reference 
image and input image are converted into binarized 
intensity distribution images and displayed as 
binarized shift-invariable intensity distribution im- 
ages. As the photographing device 466 and elec- 
trically addressed spatial light modulator 468 in this 
embodiment, a transmission type spatial light 
modulator such as a CCD camera and liquid crystal 
television is used. 

If it is not necessary to binarize shift-invariable 
intensity distribution image, the binarizing circuit 
467 is not needed. By setting an appropriate 
threshold value for binarizing, a clear binarized 
shift-invariable intensity distribution image with little 
noise can be obtained. For this reason, this em- 
bodiment employs the binarizing processing. 

The optical filter array 44 is put immediately 
before or after the electrically addressed spatial 
light modulator 468, and the coherent light emitted 
from the laser 405 reads out the shift-invariable 
intensity distribution images superimposed with the 
coordinate conversion optical filter. The processing 
that follows is the same as that of Figure 16 and 
thus its explanation is omitted. 

Figure 18 shows the configuration of a further 
embodiment of the optical pattern recognition ap- 
paratus, according to this invention, which has the 
coordinate conversion function. This represents a 
case where the reference image and the input 
image are transformed into shift-invariable images 
electronically by computer rather than optically. 
The joint transform correlator is the same as that of 
the embodiment in Figure 16 and its drawing is not 
shown. The components having functions identical 
with those of the embodiment of Figure 16 are 
given like reference numerals and their explanation 
omitted or simplified. 

The points in which the optical coordinate con- 
verter differs from the embodiment of Figure 16 are 
shown below. At least one coherent light source 
consists of a laser 405 and a beam expander 406. 
A means for producing two-dimensional reference 
image and input image consists of a photographing 
device 402, an image processing device 422 and 
an image memory device 43. A means for optically 
or electronically transforming the reference image 
and the input image into shift-invariable images 
and displaying the shift-invariable images on at 
least one shift-invariable image spatial light 
modulator consists of a computer 469 and an elec- 
trically addressed spatial light modulator 468. 

As in the embodiment shown in Figure 16, a 
two-dimensional reference image is obtained from 
the photographing device 402. The reference im- 
age is processed by the computer 469 to calculate 
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the barycenter position G and is fed through the 
image processing device 442 to the image memory 
device 43 where it is stored as a shift-invariable 
intensity distribution image. Next, the input image 
is processed similarly. The barycenter G* is cal- 5 
culated and, based on the barycenter position, the 
shift-invariable intensity distribution image is deter- 
mined. The shift-invariable intensity distribution im- 
age of the input image and the shift-invariable 
intensity distribution image of the reference image, 10 
the latter being stored in the image memory device 
43, are combined by the image processing device 
442 to display the combined image on the elec- 
trically addressed spatial light modulator 468. The 
image combination is done so that, as shown in 75 
Figure 20, the distance GG' between the barycen- 
ters on the electrically addressed spatial light 
modulator 468 is equal to the distance L between 
the coordinate conversion optical filters and that 
the relative positional relationships between the 20 
shift-invariable intensity distribution images and the 
coordinate conversion optical filters are equal. The 
processing that follows is the same as those of the 
embodiments shown in Figure 16 and 17 and its 
explanation is omitted. The optical filter array 44 25 
may be placed immediately before the electrically 
addressed spatial light modulator 468. 

Now, the image processing as performed by 
the computer 469 will be explained. First, the refer- 
ence image and the input image entered from the 30 
object image photographing device are binarized. 
The reason for digitizing the image is that the 
image taken in from the ordinary photographing 
device has a gradation and the processing of such 
an image by the computer produces a large 35 
amount of image data, requiring longer time to 
process. Next, the positions of the barycenters G, 
G' of the reference image and the input image are 
calculated. Finally, if the positions of the barycen- 
ters of the reference image and the input image 40 
agree, no further processing is done. When they do 
not agree, the input image is moved parallelly until 
the barycenters agree. 

In the input image that has been subjected to 
the above processing, the position of the barycen- 45 
ter remains unchanged regardless of the move- 
ment of the input object 1 and thus the image is a 
shift-invariable intensity distribution image. Then, 
the shift-invariable intensity distribution images of 
the reference image and the input image are lo- 50 
cated at positions corresponding to the coordinate 
conversion optical filters so that the distance be- 
tween their barycenters is equal to a distance L. 
The shift-invariable intensity distribution images are 
then synthesized and displayed on the electrically 55 
addressed spatial light modulator 468. Then, the 
relative positional relationship between each shift- 
invariable intensity distribution image and the cor- 



responding coordinate conversion optical filter re- 
mains unchanged, permitting an invariable correla- 
tion processing for any shifts of the input image, as 
in other embodiments. 

In the above embodiment, if the light-ad- 
dressed spatial light modulator is replaced by a 
combination of a photographing device like a CCD 
camera and an electrically addressed spatial light 
modulator like a liquid crystal television, the same 
working principle is obtained. 

The above embodiment displays the reference 
image and the input image simultaneously on the 
electrically addressed spatial light modulator 403 
and performs the shift-invariable processing and 
the optical coordinate conversion processing paral- 
lelly. The same effect can be obtained in principle 
by the following method. Only the reference image 
is transformed into a shift-invariable image or a 
coordinate-converted image in advance and the 
transformed image is stored in the image memory 
device 43. Then, the input images to be processed 
successively are transformed either into shift-invari- 
able images or coordinate-converted images. The 
shift-invariable or coordinate-converted reference 
images and input images are electrically synthe- 
sized by the image processing device 442 and are 
parallelly displayed on the shift-invariable or 
coordinate-converted image electrically addressed 
spatial light modulator for correlation processing. 

In the above embodiment, the lasers 5, 25, 
405, 461, 101 , 201 need only be such lasers as 
gas laser or semiconductor laser that has a good 
coherence. While the above embodiment uses 
many lasers, it is possible to split the output from 
one laser into many beams. 

While the above embodiment employs a trans- 
mission type electrically addressed spatial light 
modulator 3, 23, 403 to display the reference im- 
age and the input image parallelly, it is also possi- 
ble to use a reflection type light-addressed spatial 
light modulator to produce the similar effect. 

While, in the above embodiment, the reference 
object 21 is photographed by the photographing 
device 22 and the reference image is stored in the 
image memory device 43, it is possible to photo- 
graph the reference object 21 along with the input 
object 1 by the photographing device 2, 22, 402 
and display them on the electrically addressed 
spatial light modulator 3, 403. In this case, since 
there is no need to synthesize the reference image 
and the input image, the image processing device 
42, 442 and the image memory device 43 are not 
required. 

The above embodiment stores the reference 
image in the image memory device 43. However, it 
is also possible to photograph the reference object 
21 and the input object 1 by separate object image 
photographing devices and synthesize the refer- 
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ence image and the input image by the image 
processing device 42, 442 to display the synthe- 
sized image on the electrically addressed spatial 
light modulator 3, 403. In this case, the image 
memory device 43 becomes unnecessary. 5 

The above embodiment synthesizes the refer- 
ence image and the input image by the image 
processing device 42, 442 and displays the elec- 
trically addressed spatial light modulator 3, 403. 
Rather than synthesizing the reference image and 10 
the input image, it is possible to display them on 
two parallelly arranged electrically addressed spa- 
tial light modulators for object image. 

In the above embodiment the correlation pro- 
cessing is performed between one reference image 15 
and one input image. When a number of correlation 
processings are to be performed by using multiple 
input images or reference images, it is only neces- 
sary to increase the number of shift-invariable len- 
ses such as lens array 64, 464, the coordinate 20 
conversion optical filters such as optical filter array 
44 and the coordinate conversion lenses such as 
lens array 47 and arrange them at positions cor- 
responding to the reference images and input im- 
ages. 25 

In the embodiment shown above, the coordi- 
nate conversion into optical shift-invariable images 
is done by using the shift-invariable lens array 64, 
464 and the coordinate-conversion lens array 47. 
Rather than using the lens array, the images may 30 
be converted into the shift-invariable images or 
coordinate-converted images by using separate op- 
tical systems. The converted images may then be 
synthesized by the beam splitter and radiated onto 
the write plane of the shift-invariable image light- 35 
addressed spatial light modulator 65, 465 and the 
coordinate conversion light-addressed spatial light 
modulator 13, 413. 

The coordinate conversion optical filter may be 
of an amplitude modulation type or a phase modu- 40 
lation type. 

As described above, this invention employs as 
the preprocessing for the joint transform correlator 
the optical coordinate convertor that performs co- 
ordinate conversion on the reference image and 45 
the input image. This permits accurate pattern rec- 
ognition even when the input object changes its 
size and direction, in the optical coordinate conver- 
tor, the reference image and the input image are 
converted into shift-invariable images before being 50 
subjected to the optical coordinate conversion. This 
allows an invariable pattern recognition when the 
position of the input image changes. Further, when 
the light-addressed or electrically addressed spatial 
light modulator formed of ferroelectric liquid crystal 55 
is used, high-speed operation at around 30Hz-2kHz 
is possible. Moreover, when a feedback system is 
added, the reference object can also be 



correlation-processed at the same time. The inven- 
tion enables changing the kind of coordinate con- 
version and the reference image at high speed and 
with ease. These in turn permit a very quick and 
accurate pattern recognition, leading to an in- 
creased operation speed and lower cost in the 
fields of pattern recognition and inspection sys- 
tems. 

Claims 

1. In an optical pattern recognition apparatus 
which automatically identifies and measures 
specified patterns by performing optical cor- 
relation processing, by using coherent light, on 
two-dimensional images obtained from a 
photographing means; the optical pattern rec- 
ognition apparatus, which has a coordinate 
conversion function, comprising: 

an optical coordinate convertor unit for 
converting at least one reference image and at 
least one input image to be entered, from one 
coordinate system to a desired coordinate sys- 
tem to produce coordinate-converted image; 
and 

a joint transform correlator for generating 
correlation coefficients between the coordinate- 
converted reference image and the coordinate- 
converted input image, both produced by the 
optical coordinate convertor; 

the optical coordinate convertor compris- 
ing: 

a means for producing two-dimensional 
reference image and input image; 

at least one coherent light source; 

at least one object image spatial light 
modulator which holds the reference image 
and the input image; 

at least one coordinate conversion optical 
filter placed close to the object image spatial 
light modulator; and 

at least one lens; 

the joint transform correlator comprising: 

a means for converting the coordinate-con- 
verted reference image and the coordinate- 
converted input image produced by the optical 
coordinate convertor into coordinate-converted 
intensity distribution images and then display- 
ing the coordinate-converted intensity distribu- 
tion images on a spatial light modulator for the 
coordinate-converted images; 

a means for converting the coordinate-con- 
verted intensity distribution images displayed 
on the coordinate-converted image spatial light 
modulator into coherent images; 

a means for converting the coherent image 
by using a lens for Fourier-transforming into a 
joint Fourier-transformed image of the 
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coordinate-converted intensity distribution im- 
ages; 

a means for converting the joint Fourier- 
transformed image into a Fourier-transformed 
intensity distribution image and displaying the 5 
Fourier-transformed intensity distribution image 
on a spatial light modulator for the Fourier- 
transformed image; 

a means for reading the Fourier-trans- 
formed intensity distribution image displayed w 
on the Fourier-transformed image spatial light 
modulator by using coherent light; 

a means for converting a correlation output 
image, obtained by Fourier-transforming the 
Fourier-transformed intensity distribution image 75 
by using a lens, into a correlation signal by a 
photographing device or light receiving ele- 
ment; and 

a means for processing the correlation sig- 
nal to determine two-dimensional correlation 20 
coefficients of the reference image and the 
input image. 

2. An optical pattern recognition apparatus having 

a coordinate conversion function as claimed in 25 
claim 1, further comprising a feedback circuit, 
the feedback circuit comprising: 

a normalization circuit for normalizing the 
correlation coefficients with a maximum cor- 
relation coefficient; 30 

a mask spatial light modulator placed im- 
mediately before or after the object image spa- 
tial light modulator or the coordinate-converted 
image spatial light modulator; and 

a means for changing the transmission 35 
factor or the reflection factor of parts of the 
mask spatial light modulator that correspond to 
the reference images or the coordinate-con- 
verted intensity distribution image in a linear or 
non-linear relationship according to the correla- 40 
tion coefficient normalized by the normalization 
circuit. 

3. An optical pattern recognition apparatus having 

a coordinate conversion function as claimed in 45 
claim 2, wherein the transmission factor or the 
reflection factor of parts of the mask spatial 
light modulator that correspond to the refer- 
ence image and the input image or to the 
coordinate-converted intensity distribution im- so 
ages is changed according to the ratio of areas 
between the reference image and the input 
image or between their coordinate-converted 
intensity distribution images or according to 
the transmitted or reflected light intensity, and 55 
a normalization means is provided to make 
equal the intensities of the Fourier-transformed 
images of the coordinate-converted intensity 



distribution images. 

4. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 2, wherein the non-linear relationship in 
the feedback circuit is represented either by a 
saturation type function, or a step function with 
more than one stage, or a combination of both. 

5. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 1 , wherein the optical coordinate conver- 
ter unit comprising: 

at least one coherent light source; 

a means for producing two-dimensional 
reference image and input image; 

a means for optically or electronically con- 
verting the reference image and the input im- 
age into shift-invariable images and then dis- 
playing the shift-invariable reference image 
and input image on at least one shift-invariable 
image spatial light modulator; 

a least one coordinate conversion optical 
filter placed close to the shift-invariable image 
spatial light modulator to convert the images 
into a desired coordinate system; and 

at least one lens. 

6. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 5, wherein the means for optically or 
electronically converting the reference image 
and the input image into shift-invariable images 
and then displaying the shift-invariable refer- 
ence image and input image on at least one 
shift-invariable image spatial light modulator 
comprising: 

a means for Fourier-transforming the refer- 
ence image and the input image by using 
coherent light into the shift-invariable images; 
and 

a means for converting the shift-invariable 
images into shift-invariable intensity distribution 
images and displaying the shift-invariable in- 
tensity distribution images on the shift-invari- 
able image spatial light modulator. 

7. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 5, wherein the means for optically or 
electronically converting the reference image 
and the input image into shift-invariable images 
and then displaying the shift-invariable refer- 
ence image and input image on at least one 
shift-invariable image spatial light modulator, 
which converts the reference image and the 
input image into shift-invariable intensity dis- 
tribution images by a computer image pro- 
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cessing and displaying the shift-invariable in- 
tensity distribution images on the shift-invari- 
able image spatial light modulator. 

8. An optical pattern recognition apparatus having 5 
a coordinate conversion function a*s claimed in 
claim 6, wherein the means for converting the 
shift-invariable images into the shift-invariable 
intensity distribution images and displaying the 
shift-invariable intensity distribution images on 10 
the shift-invariable image spatial light modula- 
tor, which converts the shift-invariable images 

into binarized shift-invariable intensity distribu- 
tion images and then displaying the shift-invari- 
able intensity distribution images on the shift- 75 
invariable image spatial light modulator. 

9. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 8, wherein the means for converting the 20 
shift-invariable images into the binarized shift- 
invariable intensity distribution images and dis- 
playing the binarized shift-invariable intensity 
distribution images on the shift-invariable im- 
age spatial light modulator, which radiates the 25 
shift-invariable images onto a light-addressed, 
shift-invariable image spatial light modulator to 
store these images, the shift-invariable image 
spatial light modulator using a ferroelectric liq- 
uid crystal having a bistable memory capabil- 30 
ity. 

10. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 8, wherein the means for converting the 35 
shift-invariable images into the binarized shift- 
invariable intensity distribution images and dis- 
playing the digitized shift-invariable intensity 
distribution images on the shift-invariable im- 
age spatial light modulator comprising: ao 

a photographing device for converting the 
shift-invariable images to image signals; 

a binarizing means for binarizing the im- 
age signals; and 

an electrically addressed shift-invariable 45 
image spatial light modulator for displaying the 
binalized image signal. 

11. An optical pattern recognition apparatus having 

a coordinate conversion function as claimed in 50 
claim 8, wherein the shift-invariable image spa- 
tial light modulator is an electrically addressed 
spatial light modulator using a ferroelectric liq- 
uid crystal having a bistable memory capabil- 
ity. 55 

12. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 



claim 1, wherein the means for converting the 
coordinate-converted reference image and in- 
put image into coordinate-converted intensity 
distribution images and then displaying the 
coordinate-converted intensity distribution im- 
ages on the coordinate-converted image spa- 
tial light modulator, which converts the 
coordinate-converted images into binarized 
coordinate-converted intensity distribution im- 
ages and displaying them on the coordinate- 
converted image spatial light modulator. 

13. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 1, wherein the means for converting the 
joint Fourier-transformed image into the 
Fourier-transformed intensity distribution image 
and displaying the Fourier-transformed inten- 
sity distribution image on the Fourier-trans- 
formed image spatial light modulator, which 
converts the joint Fourier-transformed image 
into a binarized Fourier-transformed intensity 
distribution image and displaying the binarized 
Fourier-transformed intensity distribution image 
on the Fourier-transformed image spatial light 
modulator. 

14. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 12 or 13, wherein the coordinate-con- 
verted image spatial light modulator or the 
Fourier-transformed image spacial light 
modulator is a light-addressed spatial light 
modulator using a ferroelectric liquid crystal 
having a bistable memory capability. 

15. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 12 or 13, wherein the means for convert- 
ing the coordinate-converted images into the 
binarized coordinate-converted intensity distri- 
bution images and displaying them on the 
coordinate-converted image spatial light 
modulator or the means for converting the joint 
Fourier-transformed image into the binarized 
Fourier-transformed intensity distribution image 
and displaying the binarized Fourier-trans- 
formed intensity distribution image on the 
Fourier-transformed image spatial light 
modulator, comprising: 

a photographing device for converting the 
coordinate-converted images to image signals, 
or converting the joint Fourier-transformed im- 
age to image signal; 

a binarizing means for binarizing the im- 
age signal; and 

an electrically addressed coordinate-con- 
verted image spatial light modulator or Fourier- 
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transformed image spatial light modulator for 
displaying the binarized image signal. 

16. An optical pattern recognition apparatus having 

a coordinate conversion function as claimed in 5 
claim 11 or 12, wherein the coordinate-con- 
verted image spatial light modulator or the 
Fourier-transformed image spatial light 
modulator is an electrically addressed spatial 
light modulator using a ferroelectric liquid cry- 10 
stal having a bistable memory capability. 

17. An optical pattern recognition apparatus having 
a coordinate conversion function as claimed in 
claim 1, further comprising an automatic light 75 
regulator, the automatic light regulator includ- 
ing: 

a means for measuring the light intensity 
or change in the light intensity of the 
coordinate-converted image or joint Fourier- 20 
transformed image or of the correlation output 
image; 

a means for changing the light intensity 
according to the light intensity or the change in 
the light indensity or a means for changing the 25 
light reception sensitivity of the coordinate- 
converted image spatial light modulator, the 
Fourier-transformed image spatial light 
modulator, the photographing device or the 
light receiving element. 30 
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© An optical pattern recognition apparatus with coordinate conversion function. 



© This invention is intended to enable accurate 
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The invention comprises: 
an optical coordinate converter for displaying at 
least one reference image including specified marks 
and at least one input image to be entered on an 
^ electrically addressed spatial light modulator 3 for 
m object image and then converting the displayed im- 
q ages from one coordinate system to a desired co- 
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^£ ages by using the coordinate conversion optical filter 
array 44 and the coordinate conversion lens array 
LO 47; and 

q a joint transform correlator for displaying the 
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coordinate-converted intensity distribution images, 
produced by the optical coordinate converter, on the 
coordinate conversion light-addressed spatial light 
modulator 13, Fourier-transforming the coordinate- 
converted intensity distribution images into Fourier- 
transformed intensity distribution images, displaying 
the Fourier-transformed intensity distribution images 
on the Fourier transform light-addressed spatial light 
modulator 705, and Fourier-transforming again the 
Fourier-transformed intensity distribution image to 
determine the correlation coefficients of the 
coordinate-converted reference image and the 
coordinate-converted input image. 

With this construction, it is possible to change 
the reference image and the kind of coordinate con- 
version easily and quickly. 
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